[ 521.725442] env[64964]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.725442] env[64964]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.738529] env[65087]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.738529] env[65087]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 524.324327] env[65087]: INFO neutron.common.config [-] Logging enabled! [ 524.324692] env[65087]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev74 [ 524.324895] env[65087]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65087) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 524.325209] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 524.325333] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 524.326156] env[65087]: WARNING oslo_policy.policy [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.326522] env[65087]: WARNING oslo_policy.policy [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.328037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] VMware NSXv3 Agent initialized successfully. [ 524.328430] env[65087]: DEBUG oslo_concurrency.lockutils [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] Acquiring lock "singleton_lock" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.328614] env[65087]: DEBUG oslo_concurrency.lockutils [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] Acquired lock "singleton_lock" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.328764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] Releasing lock "singleton_lock" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.329054] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] Full set of CONF: {{(pid=65087) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 524.329166] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ******************************************************************************** {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 524.329264] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] Configuration options gathered from: {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 524.329619] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 524.329797] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 524.329901] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ================================================================================ {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 524.330076] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] agent_down_time = 75 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.330215] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] allow_automatic_dhcp_failover = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.330350] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] allow_bulk = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.330491] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] api_extensions_path = {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.330657] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] api_paste_config = api-paste.ini {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.330802] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] auth_strategy = keystone {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.330906] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] backdoor_port = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.331010] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] backdoor_socket = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.331151] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] backlog = 4096 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.331287] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.331440] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] bind_host = 0.0.0.0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.331600] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] bind_port = 9696 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.331761] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] client_socket_timeout = 900 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.331900] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] config_dir = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.332028] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.332150] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] config_source = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.332285] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] control_exchange = neutron {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.332420] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] core_plugin = ml2 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.332554] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] debug = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.332690] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] default_availability_zones = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.332894] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.333035] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] dhcp_agent_notification = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.333168] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] dhcp_agents_per_network = 1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.333297] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] dhcp_lease_duration = 86400 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.333432] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] dhcp_load_type = networks {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.333563] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] dns_domain = openstacklocal {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.333816] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.333816] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] enable_default_route_bfd = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.333939] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] enable_default_route_ecmp = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.334067] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] enable_dvr = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.334193] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] enable_new_agents = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.334317] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.334441] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] enable_signals = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.334565] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] enable_traditional_dhcp = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.334689] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] external_dns_driver = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.334812] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] filter_validation = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.334946] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] global_physnet_mtu = 8950 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.335084] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] graceful_shutdown_timeout = 60 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.335256] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] host = cpu-1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.335390] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] host_dvr_for_dhcp = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.335519] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] http_retries = 3 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.335653] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] instance_format = [instance: %(uuid)s] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.335783] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.335912] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ipam_driver = internal {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.336048] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ipv6_pd_enabled = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.336204] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] l3_ha = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.336338] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.336467] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] l3_ha_network_physical_name = {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.336596] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] l3_ha_network_type = {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.336730] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_color = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.336859] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_config_append = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.336986] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.337125] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_dir = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.337250] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_file = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.337349] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_options = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.337479] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_rotate_interval = 1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.337615] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_rotate_interval_type = days {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.337752] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] log_rotation_type = none {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.337851] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.337949] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.338094] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.338225] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.338324] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.338451] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] max_dns_nameservers = 5 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.338575] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] max_header_line = 16384 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.338700] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] max_l3_agents_per_router = 3 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.338825] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] max_logfile_count = 30 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.338947] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] max_logfile_size_mb = 200 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.339085] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] max_subnet_host_routes = 20 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.339220] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] my_ip = 10.180.1.21 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.339349] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] my_ipv6 = ::1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.339472] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] network_auto_schedule = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.339595] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] network_link_prefix = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.339726] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.339857] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] notify_nova_on_port_data_changes = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.339986] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] notify_nova_on_port_status_changes = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.340128] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] pagination_max_limit = -1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.340295] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] publish_errors = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.340435] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] rate_limit_burst = 0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.340601] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] rate_limit_except_level = CRITICAL {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.340734] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] rate_limit_interval = 0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.340863] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] retry_until_window = 30 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.340988] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] router_distributed = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.341126] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] rpc_resources_processing_step = 20 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.341250] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] rpc_response_max_timeout = 600 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.341377] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] rpc_response_timeout = 60 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.341510] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] send_events_interval = 2 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.341662] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] service_plugins = ['router'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.341808] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] setproctitle = on {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.341933] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] shell_completion = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.342076] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] state_path = /opt/stack/data/neutron {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.342212] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] syslog_log_facility = LOG_USER {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.342341] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] tcp_keepidle = 600 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.342472] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] transport_url = **** {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.342599] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] use_journal = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.342725] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] use_json = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.342849] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] use_ssl = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.342972] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] use_stderr = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.343116] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] use_syslog = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.343239] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] vlan_qinq = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.343357] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] vlan_transparent = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.343480] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] watch_log_file = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.343605] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] wsgi_default_pool_size = 100 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.343728] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] wsgi_keep_alive = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.343885] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.344060] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] wsgi_server_debug = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.344138] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_concurrency.disable_process_locking = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344279] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344417] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344546] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344682] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344818] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.344948] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345105] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.connection_string = messaging:// {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345245] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.enabled = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345381] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.es_doc_type = notification {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345515] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.es_scroll_size = 10000 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345650] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.es_scroll_time = 2m {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345779] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.filter_error_trace = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.345913] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.hmac_keys = **** {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346056] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.sentinel_service_name = mymaster {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346197] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.socket_timeout = 0.1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346327] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.trace_requests = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346454] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler.trace_sqlalchemy = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346598] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler_jaeger.process_tags = {} {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346726] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler_jaeger.service_name_prefix = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.346857] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] profiler_otlp.service_name_prefix = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347014] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.enforce_new_defaults = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347289] env[65087]: WARNING oslo_config.cfg [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 524.347441] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.enforce_scope = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347581] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.policy_default_rule = default {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347731] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.347872] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348024] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348159] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348288] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348416] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348544] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348682] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348828] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.348973] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] agent.extensions = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349119] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349254] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] service_providers.service_provider = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349393] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.default_quota = -1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349534] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349668] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_floatingip = 50 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349796] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_network = 100 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.349923] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_port = 500 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350058] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350187] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_router = 10 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350314] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_security_group = 10 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350440] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350595] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.quota_subnet = 100 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350738] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] QUOTAS.track_quota_usage = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.350885] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351024] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep.group = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351150] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep.helper_command = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351279] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep.log_daemon_traceback = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351416] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351569] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep.thread_pool_size = 8 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351734] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep.user = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.351889] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352032] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_dhcp_release.group = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352164] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_dhcp_release.helper_command = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352293] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352431] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352566] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352697] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_dhcp_release.user = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352835] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.352961] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_ovs_vsctl.group = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353100] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353232] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353365] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353495] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353623] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_ovs_vsctl.user = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353760] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_namespace.capabilities = [21] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.353886] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_namespace.group = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.354070] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_namespace.helper_command = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.354144] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.354279] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.354402] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.354527] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_namespace.user = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.354663] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_conntrack.capabilities = [12] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.354789] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_conntrack.group = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.354919] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_conntrack.helper_command = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.355050] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.355185] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.355313] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.355436] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_conntrack.user = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.355573] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_link.capabilities = [12, 21] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.355698] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_link.group = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.355822] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_link.helper_command = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.355948] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_link.log_daemon_traceback = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.356091] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.356220] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_link.thread_pool_size = 8 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.356342] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] privsep_link.user = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.356489] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.356634] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.356768] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.continue_on_failed_promotions = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.356897] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.dscp = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.357039] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.dscp_inherit = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.357181] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.force_mp_to_policy = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.357311] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.locking_coordinator_url = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.357442] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.log_agent_heartbeats = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.357572] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.logging_expire = 1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.357714] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.357844] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.357983] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.polling_interval = 240 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.358129] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.358270] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.358408] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.report_interval = 30.0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.358550] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.358690] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.358826] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.358961] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.sync_skew = 60 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.359104] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.synchronization_queue_size = 20 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.359235] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT.use_helper_for_ns_read = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.359371] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] SECURITYGROUP.enable_ipset = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.359511] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] SECURITYGROUP.enable_security_group = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.359650] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.359791] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.359927] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] experimental.ipv6_pd_enabled = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.360094] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.extension_drivers = ['port_security'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.360230] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.external_network_type = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.360377] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.360520] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.overlay_ip_version = 4 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.360680] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.path_mtu = 8950 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.360824] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.physical_network_mtus = {} {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.360967] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.361122] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.361267] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ml2.type_drivers = ['vlan'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.361407] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.361540] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.361697] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.361841] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.361981] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.362132] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.362267] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.362403] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.362537] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.362741] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.362887] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_login_password = **** {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.363037] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.363178] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_login_user = admin {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.363320] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.363460] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.363593] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.363725] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.363860] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.363999] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.364149] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.364285] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.364442] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.364552] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.364694] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.364828] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.364966] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.365170] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.365315] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.365452] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.365612] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.365766] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.auth_section = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.365916] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.auth_type = password {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.366067] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.366197] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.certfile = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.366328] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.collect_timing = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.366469] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.endpoint_type = public {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.366608] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.insecure = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.366727] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.keyfile = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.366865] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.region_name = RegionOne {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.366995] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.split_loggers = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.367134] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] nova.timeout = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.367276] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.auth_section = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.367506] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.auth_type = password {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.367668] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.367802] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.certfile = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.367937] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.collect_timing = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.368090] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.endpoint_type = public {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.368223] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.insecure = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.368351] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.keyfile = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.368476] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.region_name = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.368605] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.split_loggers = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.368731] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] placement.timeout = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.368868] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.auth_section = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.369007] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.auth_type = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.369142] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.cafile = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.369269] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.certfile = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.369400] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.collect_timing = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.369529] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.connect_retries = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.369657] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.connect_retry_delay = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.369837] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.enable_notifications = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.369991] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.endpoint_override = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.370153] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.insecure = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.370294] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.interface = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.370423] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.keyfile = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.370580] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.max_version = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.370722] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.min_version = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.370852] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.region_name = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.370984] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.retriable_status_codes = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.371124] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.service_name = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.371250] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.service_type = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.371378] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.split_loggers = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.371508] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.status_code_retries = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.371647] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.status_code_retry_delay = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.371786] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.timeout = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.371913] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.valid_interfaces = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.372049] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ironic.version = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.372187] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] cli_script.dry_run = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.372329] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.372458] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.372590] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.372719] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.372854] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.372981] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.373312] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.373312] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.373369] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.373499] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.373622] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.373761] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.373897] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.374035] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.374167] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.374329] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.374428] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.374583] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.374688] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.374819] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.374946] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.375082] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.375210] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.375336] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.375464] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.375718] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.375869] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.376018] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.376148] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.376280] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.376412] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.ssl = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.376554] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.376694] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.376824] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.376958] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.377103] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.377234] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.377375] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_notifications.driver = [] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.377508] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_notifications.retry = -1 {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.377654] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.377785] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.377887] env[65087]: DEBUG oslo_service.backend._eventlet.service [None req-d6438ad5-0ab2-46f4-bc34-e1f4c086e293 None None] ******************************************************************************** {{(pid=65087) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 524.379027] env[65087]: DEBUG neutron.agent.securitygroups_rpc [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Init firewall settings (driver=nsxv3) {{(pid=65087) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 524.380364] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65087) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 524.380630] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] RPC agent_id: nsxm-l-01a.corp.local [ 524.382917] env[65087]: DEBUG dogpile.cache.region [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.383051] env[65087]: DEBUG dogpile.lock [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 524.383151] env[65087]: DEBUG dogpile.lock [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 524.383247] env[65087]: DEBUG dogpile.lock [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 524.383343] env[65087]: DEBUG dogpile.cache.region [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.383434] env[65087]: DEBUG dogpile.lock [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 524.383560] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 524.402754] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Session token - acquiring [ 524.404773] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.404961] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.404961] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.405430] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.416188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.697425] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 524.716970] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 524.717134] env[65087]: DEBUG dogpile.cache.region [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Cache value generated in 0.334 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 524.717257] env[65087]: DEBUG dogpile.lock [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 524.717377] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Activating Policy API Provider. [ 524.717572] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Looking for the default Infrastructure Rules. [ 524.794983] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Looking for the Default Layer3 Logged Drop Section. [ 524.810264] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 524.810770] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.810945] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.811081] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.811375] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.811721] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.330685] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.833025] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.335666] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Inventory metadata is going to be refreshed. [ 526.336084] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.086866] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.087197] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.087197] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.087685] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.100894] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.101752] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.102357] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 527.119296] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.119509] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.119563] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.119868] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.120010] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.120174] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 527.120285] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.120393] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 527.139789] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.140029] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.140076] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.140374] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.140641] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.140808] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 527.159898] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.160182] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.160182] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.160459] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.160733] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.160936] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 527.183729] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.183940] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.183997] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.184317] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.184460] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.184610] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 527.184716] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.185190] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 527.203313] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.203543] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.203587] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.203877] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.204011] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.204158] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 527.204261] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.204364] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 527.225131] env[65087]: DEBUG networking_nsxv3.common.locking [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.225378] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.225432] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.225711] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.225884] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.226060] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 527.226168] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.226270] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Inventory metadata have been refreshed. [ 527.226369] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Dryrun:True. Metadata refresh completed. [ 527.226487] env[65087]: DEBUG oslo_concurrency.lockutils [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Releasing lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.228180] env[65087]: INFO neutron.agent.agent_extensions_manager [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Loaded agent extensions: [] [ 527.228902] env[65087]: DEBUG neutron_lib.callbacks.manager [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65087) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 527.288773] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent RPC Daemon Started! [ 527.289013] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:0 started [ 527.289013] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent out of sync with plugin! [ 532.230142] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 532.230617] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 537.231544] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.231544] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.233129] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.233445] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.433029] env[65087]: INFO networking_nsxv3.common.synchronization [None req-dfe86911-408d-42c5-a4f6-e8487b2c3e9d demo admin] Enqueued Resource ID: 9aaa596d-169d-4642-875f-c23929c0a16d with Priority: HIGHEST for action security_group_rules [ 542.433291] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aaa596d-169d-4642-875f-c23929c0a16d with Priority: HIGHEST for action security_group_rules [ 542.433653] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9aaa596d-169d-4642-875f-c23929c0a16d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.433786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9aaa596d-169d-4642-875f-c23929c0a16d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.433854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9aaa596d-169d-4642-875f-c23929c0a16d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.434253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9aaa596d-169d-4642-875f-c23929c0a16d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.434341] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9aaa596d-169d-4642-875f-c23929c0a16d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.954376] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.954587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.954587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.954779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.954876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.955038] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9aaa596d-169d-4642-875f-c23929c0a16d already deleted. [ 542.955157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9aaa596d-169d-4642-875f-c23929c0a16d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.434482] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 547.434925] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 552.435199] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.435594] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 557.436680] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.436680] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.437395] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.437395] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.231540] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.232034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.232034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.232034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.232361] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.735025] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.238499] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.740985] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 566.740985] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 567.438794] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 567.439107] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 567.512654] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.512737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.512842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.513040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.524724] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 567.525585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.526574] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 567.545637] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.545866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.545866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.546061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.546137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.546258] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 567.546331] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 567.546403] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 567.567355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.567522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.567579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.567776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.567912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.568032] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 567.591777] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.591932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.592018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.592236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.592425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.592544] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 567.612780] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.612923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.612970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.613201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.613320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.613423] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 567.613504] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 567.613731] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 567.631028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.631247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.631314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.631537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.631629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.631745] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 567.631819] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 567.631892] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 567.656748] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.656887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.656969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.657196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.657358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.657519] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 567.657600] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 567.657666] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 567.657729] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 567.657806] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 567.657871] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 567.657927] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 567.658235] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 567.658304] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 567.658374] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 567.679753] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.679926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.679996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.680199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.680312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.680424] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 567.705918] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.706104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.706236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.706432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.706557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.720123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.439958] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 572.440230] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.069724] env[65087]: INFO networking_nsxv3.common.synchronization [None req-d425bfb2-65f5-419f-9225-0bd8af4f3997 None None] Enqueued Resource ID: d61c17d2-600d-4545-9d12-7f26dc27ce8a with Priority: HIGHEST for action port [ 574.070460] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d61c17d2-600d-4545-9d12-7f26dc27ce8a with Priority: HIGHEST for action port [ 574.070802] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d61c17d2-600d-4545-9d12-7f26dc27ce8a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.070802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d61c17d2-600d-4545-9d12-7f26dc27ce8a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.070802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d61c17d2-600d-4545-9d12-7f26dc27ce8a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.072092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d61c17d2-600d-4545-9d12-7f26dc27ce8a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.072092] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d61c17d2-600d-4545-9d12-7f26dc27ce8a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.247219] env[65087]: INFO networking_nsxv3.common.synchronization [None req-2f5337af-1528-4773-a616-06d75c34ea1f None None] Enqueued Resource ID: 5111106e-4651-4473-a674-59ed6b84047c with Priority: HIGHEST for action port [ 574.247516] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5111106e-4651-4473-a674-59ed6b84047c with Priority: HIGHEST for action port [ 574.250136] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5111106e-4651-4473-a674-59ed6b84047c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.250256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5111106e-4651-4473-a674-59ed6b84047c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.250256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5111106e-4651-4473-a674-59ed6b84047c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.250459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5111106e-4651-4473-a674-59ed6b84047c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.250545] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5111106e-4651-4473-a674-59ed6b84047c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.582649] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d61c17d2-600d-4545-9d12-7f26dc27ce8a [ 574.582649] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.582649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.582649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.582649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.582649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.582649] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d61c17d2-600d-4545-9d12-7f26dc27ce8a already deleted. [ 574.582649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d61c17d2-600d-4545-9d12-7f26dc27ce8a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.757830] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5111106e-4651-4473-a674-59ed6b84047c [ 574.757830] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.757967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.757999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.758223] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.758312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.758406] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5111106e-4651-4473-a674-59ed6b84047c already deleted. [ 574.758488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5111106e-4651-4473-a674-59ed6b84047c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.653807] env[65087]: INFO networking_nsxv3.common.synchronization [None req-01474c6a-3a22-4de6-b9d3-688f1c504cd6 None None] Enqueued Resource ID: 6429a13e-b8aa-4f78-9f19-b182353e492d with Priority: HIGHEST for action port [ 575.654091] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6429a13e-b8aa-4f78-9f19-b182353e492d with Priority: HIGHEST for action port [ 575.654664] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-6429a13e-b8aa-4f78-9f19-b182353e492d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.654798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6429a13e-b8aa-4f78-9f19-b182353e492d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.654863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6429a13e-b8aa-4f78-9f19-b182353e492d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.655855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6429a13e-b8aa-4f78-9f19-b182353e492d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.655855] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6429a13e-b8aa-4f78-9f19-b182353e492d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.830045] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c11864ad-9fcf-4416-a734-d3b0d9787d40 None None] Enqueued Resource ID: 7c626a1e-cffc-4740-9890-5aad4a886793 with Priority: HIGHEST for action port [ 575.831474] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c626a1e-cffc-4740-9890-5aad4a886793 with Priority: HIGHEST for action port [ 575.831639] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c626a1e-cffc-4740-9890-5aad4a886793 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.831719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c626a1e-cffc-4740-9890-5aad4a886793" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.831759] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c626a1e-cffc-4740-9890-5aad4a886793" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.833304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c626a1e-cffc-4740-9890-5aad4a886793" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.833431] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c626a1e-cffc-4740-9890-5aad4a886793',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.159362] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6429a13e-b8aa-4f78-9f19-b182353e492d [ 576.159621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.159763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.159833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.160067] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.160162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.160256] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6429a13e-b8aa-4f78-9f19-b182353e492d already deleted. [ 576.160338] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6429a13e-b8aa-4f78-9f19-b182353e492d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.339124] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c626a1e-cffc-4740-9890-5aad4a886793 [ 576.339124] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.339124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.339124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.339124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.339124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.339124] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c626a1e-cffc-4740-9890-5aad4a886793 already deleted. [ 576.339124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c626a1e-cffc-4740-9890-5aad4a886793" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.132611] env[65087]: INFO networking_nsxv3.common.synchronization [None req-932ed765-5d98-4cad-9061-8fe62c731700 None None] Enqueued Resource ID: d29534f5-f8ad-4de2-a06e-eb632433da26 with Priority: HIGHEST for action port [ 577.132870] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d29534f5-f8ad-4de2-a06e-eb632433da26 with Priority: HIGHEST for action port [ 577.133443] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d29534f5-f8ad-4de2-a06e-eb632433da26 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.133577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d29534f5-f8ad-4de2-a06e-eb632433da26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.133647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d29534f5-f8ad-4de2-a06e-eb632433da26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.133909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d29534f5-f8ad-4de2-a06e-eb632433da26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.133988] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d29534f5-f8ad-4de2-a06e-eb632433da26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.640116] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d29534f5-f8ad-4de2-a06e-eb632433da26 [ 577.640116] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.642026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.642026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.642138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.642138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.642246] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d29534f5-f8ad-4de2-a06e-eb632433da26 already deleted. [ 577.642327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d29534f5-f8ad-4de2-a06e-eb632433da26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.149799] env[65087]: INFO networking_nsxv3.common.synchronization [None req-224e1e81-1ce4-4813-bc9a-4cf02ecd29a3 None None] Enqueued Resource ID: 6f09fea3-eb9e-4011-9904-ba5455ce3d21 with Priority: HIGHEST for action port [ 578.150108] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f09fea3-eb9e-4011-9904-ba5455ce3d21 with Priority: HIGHEST for action port [ 578.150495] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f09fea3-eb9e-4011-9904-ba5455ce3d21 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.150604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f09fea3-eb9e-4011-9904-ba5455ce3d21" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.150680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f09fea3-eb9e-4011-9904-ba5455ce3d21" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.150929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f09fea3-eb9e-4011-9904-ba5455ce3d21" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.151806] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f09fea3-eb9e-4011-9904-ba5455ce3d21',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.446863] env[65087]: INFO networking_nsxv3.common.synchronization [None req-68897cf1-26f3-48c2-bdfe-31fc95f6c309 None None] Enqueued Resource ID: b2377fc2-5673-4cdb-9130-55bfcb481421 with Priority: HIGHEST for action port [ 578.447127] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2377fc2-5673-4cdb-9130-55bfcb481421 with Priority: HIGHEST for action port [ 578.447684] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2377fc2-5673-4cdb-9130-55bfcb481421 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.447836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2377fc2-5673-4cdb-9130-55bfcb481421" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.447879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2377fc2-5673-4cdb-9130-55bfcb481421" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.448229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2377fc2-5673-4cdb-9130-55bfcb481421" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.449147] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2377fc2-5673-4cdb-9130-55bfcb481421',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.656959] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f09fea3-eb9e-4011-9904-ba5455ce3d21 [ 578.656959] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.656959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.656959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.656959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.656959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.656959] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f09fea3-eb9e-4011-9904-ba5455ce3d21 already deleted. [ 578.656959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f09fea3-eb9e-4011-9904-ba5455ce3d21" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.952387] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2377fc2-5673-4cdb-9130-55bfcb481421 [ 578.952787] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.952787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.952928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.953052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.953142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.953330] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2377fc2-5673-4cdb-9130-55bfcb481421 already deleted. [ 578.953330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2377fc2-5673-4cdb-9130-55bfcb481421" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.042594] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c2d120fd-f987-47c0-8439-09cea5e3d933 None None] Enqueued Resource ID: 7fd341e8-0380-40a7-86bd-b86480f4d60d with Priority: HIGHEST for action port [ 580.043142] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fd341e8-0380-40a7-86bd-b86480f4d60d with Priority: HIGHEST for action port [ 580.043441] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fd341e8-0380-40a7-86bd-b86480f4d60d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.043567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fd341e8-0380-40a7-86bd-b86480f4d60d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.043636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fd341e8-0380-40a7-86bd-b86480f4d60d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.043887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fd341e8-0380-40a7-86bd-b86480f4d60d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.043984] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fd341e8-0380-40a7-86bd-b86480f4d60d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.328102] env[65087]: INFO networking_nsxv3.common.synchronization [None req-7a312c2f-2133-4b43-98a2-d0d5b3629b4f None None] Enqueued Resource ID: 8d71cbdd-afa6-48c2-b338-30de0fdc29a4 with Priority: HIGHEST for action port [ 580.330272] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d71cbdd-afa6-48c2-b338-30de0fdc29a4 with Priority: HIGHEST for action port [ 580.330618] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d71cbdd-afa6-48c2-b338-30de0fdc29a4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.330758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d71cbdd-afa6-48c2-b338-30de0fdc29a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.330840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d71cbdd-afa6-48c2-b338-30de0fdc29a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.331112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d71cbdd-afa6-48c2-b338-30de0fdc29a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.331197] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d71cbdd-afa6-48c2-b338-30de0fdc29a4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.549687] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fd341e8-0380-40a7-86bd-b86480f4d60d [ 580.549955] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.550129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.550264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.550479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.550546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.550577] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fd341e8-0380-40a7-86bd-b86480f4d60d already deleted. [ 580.550664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fd341e8-0380-40a7-86bd-b86480f4d60d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.835076] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d71cbdd-afa6-48c2-b338-30de0fdc29a4 [ 580.835300] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.835457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.835576] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.835810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.835902] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.836054] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d71cbdd-afa6-48c2-b338-30de0fdc29a4 already deleted. [ 580.836123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d71cbdd-afa6-48c2-b338-30de0fdc29a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.045754] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5e26228d-26a5-4178-8c51-cea7ccc2f4a9 None None] Enqueued Resource ID: d73ec7ec-b4f5-48e3-982d-62612cf8c6b1 with Priority: HIGHEST for action port [ 581.045754] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d73ec7ec-b4f5-48e3-982d-62612cf8c6b1 with Priority: HIGHEST for action port [ 581.046300] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d73ec7ec-b4f5-48e3-982d-62612cf8c6b1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.046440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d73ec7ec-b4f5-48e3-982d-62612cf8c6b1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.046495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d73ec7ec-b4f5-48e3-982d-62612cf8c6b1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.046761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d73ec7ec-b4f5-48e3-982d-62612cf8c6b1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.046848] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d73ec7ec-b4f5-48e3-982d-62612cf8c6b1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.177723] env[65087]: INFO networking_nsxv3.common.synchronization [None req-067ca5a6-20a5-4ddd-ab5e-30872b7133f2 None None] Enqueued Resource ID: 2c140977-c55f-479a-9ed4-404d3caa3c24 with Priority: HIGHEST for action port [ 581.177959] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c140977-c55f-479a-9ed4-404d3caa3c24 with Priority: HIGHEST for action port [ 581.178496] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c140977-c55f-479a-9ed4-404d3caa3c24 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.178641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c140977-c55f-479a-9ed4-404d3caa3c24" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.178711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c140977-c55f-479a-9ed4-404d3caa3c24" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.178947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c140977-c55f-479a-9ed4-404d3caa3c24" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.179090] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c140977-c55f-479a-9ed4-404d3caa3c24',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.550357] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d73ec7ec-b4f5-48e3-982d-62612cf8c6b1 [ 581.550357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.550357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.550574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.550619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.550769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.550875] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d73ec7ec-b4f5-48e3-982d-62612cf8c6b1 already deleted. [ 581.550960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d73ec7ec-b4f5-48e3-982d-62612cf8c6b1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.681575] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c140977-c55f-479a-9ed4-404d3caa3c24 [ 581.682019] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.682019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.682151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.682371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.682371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.682501] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c140977-c55f-479a-9ed4-404d3caa3c24 already deleted. [ 581.683299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c140977-c55f-479a-9ed4-404d3caa3c24" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.128445] env[65087]: INFO networking_nsxv3.common.synchronization [None req-40238134-0c2b-4ab6-a202-af304bb149e9 None None] Enqueued Resource ID: e7afa6f2-9a19-4680-8b6a-fa0c9e90466a with Priority: HIGHEST for action port [ 583.128837] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7afa6f2-9a19-4680-8b6a-fa0c9e90466a with Priority: HIGHEST for action port [ 583.129781] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7afa6f2-9a19-4680-8b6a-fa0c9e90466a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.129966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7afa6f2-9a19-4680-8b6a-fa0c9e90466a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.130090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7afa6f2-9a19-4680-8b6a-fa0c9e90466a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.130375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7afa6f2-9a19-4680-8b6a-fa0c9e90466a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.130507] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7afa6f2-9a19-4680-8b6a-fa0c9e90466a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.634429] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7afa6f2-9a19-4680-8b6a-fa0c9e90466a [ 583.634671] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.634817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.634890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.635119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.635213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.635307] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7afa6f2-9a19-4680-8b6a-fa0c9e90466a already deleted. [ 583.635390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7afa6f2-9a19-4680-8b6a-fa0c9e90466a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.138260] env[65087]: INFO networking_nsxv3.common.synchronization [None req-1065be3c-267f-48c1-b838-7365c3ac0c46 None None] Enqueued Resource ID: dfc15ec5-b5b3-42ae-91c5-747df0332f01 with Priority: HIGHEST for action port [ 584.139130] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc15ec5-b5b3-42ae-91c5-747df0332f01 with Priority: HIGHEST for action port [ 584.139596] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfc15ec5-b5b3-42ae-91c5-747df0332f01 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.139596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfc15ec5-b5b3-42ae-91c5-747df0332f01" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.139719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfc15ec5-b5b3-42ae-91c5-747df0332f01" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.139894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfc15ec5-b5b3-42ae-91c5-747df0332f01" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.139974] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfc15ec5-b5b3-42ae-91c5-747df0332f01',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.643558] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfc15ec5-b5b3-42ae-91c5-747df0332f01 [ 584.643836] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.643982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.644069] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.644289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.644385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.644483] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfc15ec5-b5b3-42ae-91c5-747df0332f01 already deleted. [ 584.644565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfc15ec5-b5b3-42ae-91c5-747df0332f01" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.405715] env[65087]: INFO networking_nsxv3.common.synchronization [None req-6dde2548-1f88-48d2-880a-8a4932211d0f None None] Enqueued Resource ID: 6255ab25-16a2-4510-9448-f29ba7a418da with Priority: HIGHEST for action port [ 585.407193] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6255ab25-16a2-4510-9448-f29ba7a418da with Priority: HIGHEST for action port [ 585.408167] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-6255ab25-16a2-4510-9448-f29ba7a418da taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.408718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6255ab25-16a2-4510-9448-f29ba7a418da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.408718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6255ab25-16a2-4510-9448-f29ba7a418da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.408826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6255ab25-16a2-4510-9448-f29ba7a418da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.409031] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6255ab25-16a2-4510-9448-f29ba7a418da',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.474137] env[65087]: INFO networking_nsxv3.common.synchronization [None req-10a01de6-e588-46fd-a792-7cf7dba5f0ea None None] Enqueued Resource ID: 955652c5-3d42-42a2-b692-b112757dcf31 with Priority: HIGHEST for action port [ 585.474137] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 955652c5-3d42-42a2-b692-b112757dcf31 with Priority: HIGHEST for action port [ 585.475248] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-955652c5-3d42-42a2-b692-b112757dcf31 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.475248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-955652c5-3d42-42a2-b692-b112757dcf31" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.475248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-955652c5-3d42-42a2-b692-b112757dcf31" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.479736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-955652c5-3d42-42a2-b692-b112757dcf31" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.479736] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('955652c5-3d42-42a2-b692-b112757dcf31',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.914464] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6255ab25-16a2-4510-9448-f29ba7a418da [ 585.914464] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.914464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.914464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.914464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.914464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.914464] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6255ab25-16a2-4510-9448-f29ba7a418da already deleted. [ 585.914464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6255ab25-16a2-4510-9448-f29ba7a418da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.979873] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 955652c5-3d42-42a2-b692-b112757dcf31 [ 585.980258] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.980392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.980392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.980602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.980695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.980791] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:955652c5-3d42-42a2-b692-b112757dcf31 already deleted. [ 585.980879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-955652c5-3d42-42a2-b692-b112757dcf31" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.383422] env[65087]: INFO networking_nsxv3.common.synchronization [None req-31d20dc3-0045-4117-83e4-caaac4dd0352 None None] Enqueued Resource ID: 3ffeafe6-0b55-499d-9a13-43283df8e6f5 with Priority: HIGHEST for action port [ 586.384406] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ffeafe6-0b55-499d-9a13-43283df8e6f5 with Priority: HIGHEST for action port [ 586.384741] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ffeafe6-0b55-499d-9a13-43283df8e6f5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.384881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ffeafe6-0b55-499d-9a13-43283df8e6f5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.384951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ffeafe6-0b55-499d-9a13-43283df8e6f5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.385381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ffeafe6-0b55-499d-9a13-43283df8e6f5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.385488] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ffeafe6-0b55-499d-9a13-43283df8e6f5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.887468] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ffeafe6-0b55-499d-9a13-43283df8e6f5 [ 586.887833] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.888038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.888175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.888408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.888508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.888609] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ffeafe6-0b55-499d-9a13-43283df8e6f5 already deleted. [ 586.888695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ffeafe6-0b55-499d-9a13-43283df8e6f5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.655661] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c7b9bff-6cc8-4290-9626-35badae42d07 req-e8ceea2e-460b-472f-b777-4a22b235a318 tempest-ServerDiagnosticsTest-2019665037 tempest-ServerDiagnosticsTest-2019665037-project-member] Enqueued Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGHEST for action security_group_members [ 587.655777] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGHEST for action security_group_members [ 587.656663] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.658227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.658227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.658227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.658227] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.658227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.658227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.658227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.658227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.658227] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.734120] env[65087]: INFO networking_nsxv3.common.synchronization [None req-651e12cf-035d-4ade-904c-7c41adcbf129 None None] Enqueued Resource ID: 61805ab2-349a-4773-8214-ba9adfa4d540 with Priority: HIGHEST for action port [ 587.734633] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61805ab2-349a-4773-8214-ba9adfa4d540 with Priority: HIGHEST for action port [ 587.735079] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-61805ab2-349a-4773-8214-ba9adfa4d540 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.735622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61805ab2-349a-4773-8214-ba9adfa4d540" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.735622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61805ab2-349a-4773-8214-ba9adfa4d540" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.735778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61805ab2-349a-4773-8214-ba9adfa4d540" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.735911] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61805ab2-349a-4773-8214-ba9adfa4d540',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.161813] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.162356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.162356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.162356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.162356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.162664] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.162664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.165168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.165168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.165168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.165168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b already deleted. [ 588.165168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.241969] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61805ab2-349a-4773-8214-ba9adfa4d540 [ 588.242243] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.242387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.242462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.242865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.242983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.243112] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61805ab2-349a-4773-8214-ba9adfa4d540 already deleted. [ 588.243203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61805ab2-349a-4773-8214-ba9adfa4d540" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.747129] env[65087]: INFO networking_nsxv3.common.synchronization [None req-51c87682-0ab9-4ab4-8835-5cc441f7f10f None None] Enqueued Resource ID: f9def075-7fc7-41f2-80cd-1b940bf9b34d with Priority: HIGHEST for action port [ 588.747399] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9def075-7fc7-41f2-80cd-1b940bf9b34d with Priority: HIGHEST for action port [ 588.747975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9def075-7fc7-41f2-80cd-1b940bf9b34d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.748113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9def075-7fc7-41f2-80cd-1b940bf9b34d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.748179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9def075-7fc7-41f2-80cd-1b940bf9b34d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.748469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9def075-7fc7-41f2-80cd-1b940bf9b34d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.748536] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9def075-7fc7-41f2-80cd-1b940bf9b34d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.858119] env[65087]: INFO networking_nsxv3.common.synchronization [req-72ba8d9b-3925-4d0b-9edb-e6a49feb11aa req-5526d28d-f303-4c06-8630-dff3c1a63c01 tempest-ImagesOneServerTestJSON-887301792 tempest-ImagesOneServerTestJSON-887301792-project-member] Enqueued Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGHEST for action security_group_members [ 588.860124] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGHEST for action security_group_members [ 588.860373] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-660ead40-fb4f-4eb7-87db-4a7944439f26 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.860500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.861145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.861145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.861145] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.861145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.861325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.861354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.861434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.861554] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.252406] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9def075-7fc7-41f2-80cd-1b940bf9b34d [ 589.252960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.254092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.254210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.254408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.254508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.254607] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9def075-7fc7-41f2-80cd-1b940bf9b34d already deleted. [ 589.254693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9def075-7fc7-41f2-80cd-1b940bf9b34d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.344787] env[65087]: INFO networking_nsxv3.common.synchronization [None req-eb9e3657-5875-444e-839c-b4114ceb5be0 None None] Enqueued Resource ID: 047f00c4-d49c-405e-af19-a91e971293bf with Priority: HIGHEST for action port [ 589.345335] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047f00c4-d49c-405e-af19-a91e971293bf with Priority: HIGHEST for action port [ 589.345885] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-047f00c4-d49c-405e-af19-a91e971293bf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.345885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-047f00c4-d49c-405e-af19-a91e971293bf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.345885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-047f00c4-d49c-405e-af19-a91e971293bf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.346093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-047f00c4-d49c-405e-af19-a91e971293bf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.346208] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('047f00c4-d49c-405e-af19-a91e971293bf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.364564] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.364882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.364882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.364973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.365064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.365251] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.365365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.365420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.365567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.365779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.365779] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 already deleted. [ 589.365866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.576340] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.576483] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.576547] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.576841] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.577136] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.577295] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.577401] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.577965] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.577965] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.578091] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.578138] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.578244] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.578349] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.578456] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.578560] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.578688] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.599240] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.599416] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.599575] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.599774] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.600450] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-2a52ec05-d06d-4451-b777-0946db8b7d80 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.600450] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-2a52ec05-d06d-4451-b777-0946db8b7d80" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.600450] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-2a52ec05-d06d-4451-b777-0946db8b7d80" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.600733] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-2a52ec05-d06d-4451-b777-0946db8b7d80" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.600860] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a52ec05-d06d-4451-b777-0946db8b7d80',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.603880] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.603880] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-786" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.603880] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-786" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.604105] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-786" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.604382] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.604586] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.604713] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.604995] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.605283] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.605542] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.605666] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.605773] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.605883] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.605990] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 589.606144] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.606231] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.633718] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.634043] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 589.634250] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.634452] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-786" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.634815] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-41fc078c-f21e-4b71-bb44-1aec51434da9 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.635045] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-41fc078c-f21e-4b71-bb44-1aec51434da9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.635178] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-41fc078c-f21e-4b71-bb44-1aec51434da9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.635518] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-41fc078c-f21e-4b71-bb44-1aec51434da9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.635683] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fc078c-f21e-4b71-bb44-1aec51434da9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.848806] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 047f00c4-d49c-405e-af19-a91e971293bf [ 589.849102] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.849275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.849365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.849606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.849713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.849878] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:047f00c4-d49c-405e-af19-a91e971293bf already deleted. [ 589.849925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-047f00c4-d49c-405e-af19-a91e971293bf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.108798] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.109384] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.109476] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.109792] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.110020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.110303] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 2a52ec05-d06d-4451-b777-0946db8b7d80 not found, creating... [ 590.110654] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.110887] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.111066] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.111379] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.111584] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.112123] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.112393] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.112526] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.112753] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.112887] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.113041] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 2a52ec05-d06d-4451-b777-0946db8b7d80 is going to be created. [ 590.138251] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.138485] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.138690] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.138892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.139153] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.139380] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-2a52ec05-d06d-4451-b777-0946db8b7d80" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.140470] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.140663] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.140721] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.140949] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.141103] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.141249] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 41fc078c-f21e-4b71-bb44-1aec51434da9 not found, creating... [ 590.141659] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.141749] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.141851] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.142066] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.142205] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.142694] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.142890] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.142940] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.143170] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.143306] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.143566] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 41fc078c-f21e-4b71-bb44-1aec51434da9 is going to be created. [ 590.168699] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.168919] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.168978] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.169283] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.169539] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.169767] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-41fc078c-f21e-4b71-bb44-1aec51434da9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.500129] env[65087]: INFO networking_nsxv3.common.synchronization [None req-fd8be560-be30-44a7-bcd0-746f0c230d88 None None] Enqueued Resource ID: 9ac79c9e-c194-4c24-a037-a65e915ca0a6 with Priority: HIGHEST for action port [ 590.500635] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac79c9e-c194-4c24-a037-a65e915ca0a6 with Priority: HIGHEST for action port [ 590.500945] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ac79c9e-c194-4c24-a037-a65e915ca0a6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.501091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ac79c9e-c194-4c24-a037-a65e915ca0a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.501163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ac79c9e-c194-4c24-a037-a65e915ca0a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.501414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ac79c9e-c194-4c24-a037-a65e915ca0a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.501500] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ac79c9e-c194-4c24-a037-a65e915ca0a6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.904962] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c7b9bff-6cc8-4290-9626-35badae42d07 req-e0feb140-b56c-4968-882f-0dcbb526e1d4 service nova] Enqueued Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGHEST for action security_group_rules [ 590.905168] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c7b9bff-6cc8-4290-9626-35badae42d07 req-e0feb140-b56c-4968-882f-0dcbb526e1d4 service nova] Enqueued Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGHEST for action security_group_members [ 590.905287] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c7b9bff-6cc8-4290-9626-35badae42d07 req-e0feb140-b56c-4968-882f-0dcbb526e1d4 service nova] Enqueued Resource ID: 2a52ec05-d06d-4451-b777-0946db8b7d80 with Priority: HIGHEST for action port [ 590.905983] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGHEST for action security_group_rules [ 590.905983] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGHEST for action security_group_members [ 590.905983] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a52ec05-d06d-4451-b777-0946db8b7d80 with Priority: HIGHEST for action port [ 590.906459] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.906459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.906459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.906728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.906815] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.908462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.908462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.908462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.908462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.908462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.909312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.909312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.909312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.909312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.909312] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.909882] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a52ec05-d06d-4451-b777-0946db8b7d80 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.910014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a52ec05-d06d-4451-b777-0946db8b7d80" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.910085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a52ec05-d06d-4451-b777-0946db8b7d80" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.910208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a52ec05-d06d-4451-b777-0946db8b7d80" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.910280] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a52ec05-d06d-4451-b777-0946db8b7d80',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.951929] env[65087]: INFO networking_nsxv3.common.synchronization [req-72ba8d9b-3925-4d0b-9edb-e6a49feb11aa req-b065cc52-de2f-42ab-9240-335e4c0660c5 service nova] Enqueued Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGHEST for action security_group_rules [ 590.952190] env[65087]: INFO networking_nsxv3.common.synchronization [req-72ba8d9b-3925-4d0b-9edb-e6a49feb11aa req-b065cc52-de2f-42ab-9240-335e4c0660c5 service nova] Enqueued Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGHEST for action security_group_members [ 590.952283] env[65087]: INFO networking_nsxv3.common.synchronization [req-72ba8d9b-3925-4d0b-9edb-e6a49feb11aa req-b065cc52-de2f-42ab-9240-335e4c0660c5 service nova] Enqueued Resource ID: 41fc078c-f21e-4b71-bb44-1aec51434da9 with Priority: HIGHEST for action port [ 590.952722] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGHEST for action security_group_rules [ 590.952868] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGHEST for action security_group_members [ 590.952961] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41fc078c-f21e-4b71-bb44-1aec51434da9 with Priority: HIGHEST for action port [ 590.953751] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-660ead40-fb4f-4eb7-87db-4a7944439f26 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.953751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.953751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.953983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.954173] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.954967] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-660ead40-fb4f-4eb7-87db-4a7944439f26 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.955189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.955274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.955705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.955705] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.955705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.955705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.956042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.956042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.956042] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.957140] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-41fc078c-f21e-4b71-bb44-1aec51434da9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.957140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41fc078c-f21e-4b71-bb44-1aec51434da9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.957140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41fc078c-f21e-4b71-bb44-1aec51434da9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.957140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41fc078c-f21e-4b71-bb44-1aec51434da9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.959809] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41fc078c-f21e-4b71-bb44-1aec51434da9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.003164] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ac79c9e-c194-4c24-a037-a65e915ca0a6 [ 591.003422] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.003723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.003723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.003886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.004009] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.004075] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ac79c9e-c194-4c24-a037-a65e915ca0a6 already deleted. [ 591.004160] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ac79c9e-c194-4c24-a037-a65e915ca0a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.356279] env[65087]: INFO networking_nsxv3.common.synchronization [None req-e802920e-e2e2-4cd7-8642-c35c71abeb18 None None] Enqueued Resource ID: d1694b77-dd26-4211-bee4-65fe48c0f48a with Priority: HIGHEST for action port [ 591.356813] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1694b77-dd26-4211-bee4-65fe48c0f48a with Priority: HIGHEST for action port [ 591.356948] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1694b77-dd26-4211-bee4-65fe48c0f48a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.359512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1694b77-dd26-4211-bee4-65fe48c0f48a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.359512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1694b77-dd26-4211-bee4-65fe48c0f48a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.359512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1694b77-dd26-4211-bee4-65fe48c0f48a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.359756] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1694b77-dd26-4211-bee4-65fe48c0f48a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.415546] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.415546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.421527] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.423133] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a52ec05-d06d-4451-b777-0946db8b7d80 with status ACTIVE [ 591.423133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.423133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.423133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.423133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.423133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.423133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.423133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.423133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.423488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.423488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.423488] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.423680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.423680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.423788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.423875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.423957] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a52ec05-d06d-4451-b777-0946db8b7d80 is going to be updated. [ 591.449878] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.449878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.449878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.449878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.449878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.449878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a52ec05-d06d-4451-b777-0946db8b7d80" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.459032] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.459524] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-660ead40-fb4f-4eb7-87db-4a7944439f26 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.459655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.465174] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41fc078c-f21e-4b71-bb44-1aec51434da9 with status ACTIVE [ 591.465377] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.465504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.465566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.465770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.465866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.466070] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.466150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.466207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.466354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.466433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.470155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.470398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.470398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.471201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.471201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.471201] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41fc078c-f21e-4b71-bb44-1aec51434da9 is going to be updated. [ 591.493555] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.493710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.493780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.494046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.494198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.494356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41fc078c-f21e-4b71-bb44-1aec51434da9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.610383] env[65087]: INFO networking_nsxv3.common.synchronization [None req-42ea17da-0571-4a13-9a1d-f879fa8bc3ea tempest-VolumesAssistedSnapshotsTest-1625343650 tempest-VolumesAssistedSnapshotsTest-1625343650-project-member] Enqueued Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_rules [ 591.610383] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_rules [ 591.610383] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.611101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.611101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.611837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.611970] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.861980] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1694b77-dd26-4211-bee4-65fe48c0f48a [ 591.862289] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.862388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.862463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.862779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.862877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.862978] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1694b77-dd26-4211-bee4-65fe48c0f48a already deleted. [ 591.863105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1694b77-dd26-4211-bee4-65fe48c0f48a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.923336] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.933577] env[65087]: INFO networking_nsxv3.common.synchronization [None req-b37dbb71-b701-4eef-8d1d-4a7c4a868c2b tempest-VolumesAssistedSnapshotsTest-1625343650 tempest-VolumesAssistedSnapshotsTest-1625343650-project-member] Enqueued Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_rules [ 591.933726] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_rules [ 591.934067] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.934181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.961332] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.137743] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.137743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.137743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.137743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.138015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.138092] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd already deleted. [ 592.138188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.138378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.138551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.138636] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.430424] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.430424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.430424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.430424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.430424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.430424] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b is going to be created. [ 592.464278] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.465843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.465843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.465843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.465843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.465843] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 is going to be created. [ 592.471384] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.471384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.471384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.471384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.471384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.492088] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b in Status: UNINITIALIZED for 2s [ 592.512605] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.512605] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.512799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.513384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.513384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.528501] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 in Status: UNINITIALIZED for 2s [ 592.646842] env[65087]: INFO networking_nsxv3.common.synchronization [None req-064dd5ad-b286-4269-bbf9-7e945766f3ab None None] Enqueued Resource ID: b8acb497-52f6-4330-800c-9d987f0fcbec with Priority: HIGHEST for action port [ 592.648230] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8acb497-52f6-4330-800c-9d987f0fcbec with Priority: HIGHEST for action port [ 592.650029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8acb497-52f6-4330-800c-9d987f0fcbec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.650029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8acb497-52f6-4330-800c-9d987f0fcbec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.650029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8acb497-52f6-4330-800c-9d987f0fcbec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.650029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8acb497-52f6-4330-800c-9d987f0fcbec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.650029] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8acb497-52f6-4330-800c-9d987f0fcbec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.666951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.666951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.667095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.667253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.667371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.667436] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd already deleted. [ 592.667522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.154182] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8acb497-52f6-4330-800c-9d987f0fcbec [ 593.154182] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.154182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.154182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.154474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.154474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.154567] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8acb497-52f6-4330-800c-9d987f0fcbec already deleted. [ 593.154836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8acb497-52f6-4330-800c-9d987f0fcbec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.746292] env[65087]: INFO networking_nsxv3.common.synchronization [None req-1263fa4a-bb91-4073-a9fd-1ec077af699c None None] Enqueued Resource ID: 8c7e062d-d9f2-4303-a421-bea2e01869b6 with Priority: HIGHEST for action port [ 593.747252] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c7e062d-d9f2-4303-a421-bea2e01869b6 with Priority: HIGHEST for action port [ 593.747333] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c7e062d-d9f2-4303-a421-bea2e01869b6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.747454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c7e062d-d9f2-4303-a421-bea2e01869b6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.747548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c7e062d-d9f2-4303-a421-bea2e01869b6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.747849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c7e062d-d9f2-4303-a421-bea2e01869b6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.747956] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c7e062d-d9f2-4303-a421-bea2e01869b6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.250983] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c7e062d-d9f2-4303-a421-bea2e01869b6 [ 594.251235] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.251399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.251520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.251830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.251972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.252109] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c7e062d-d9f2-4303-a421-bea2e01869b6 already deleted. [ 594.254626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c7e062d-d9f2-4303-a421-bea2e01869b6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.504647] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b in Status: SUCCESS [ 594.504647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.504647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.504647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.504647] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.504647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.504647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.504647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.504647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.504647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.504647] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.538566] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 in Status: SUCCESS [ 594.538647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.538787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.539215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.539410] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.543034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.543034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.543034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.543034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.543034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.543034] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.840254] env[65087]: INFO networking_nsxv3.common.synchronization [None req-303b3a53-9a34-430e-8340-4a73f437b67a None None] Enqueued Resource ID: a61bb164-6e2b-410a-8e44-09d93007519e with Priority: HIGHEST for action port [ 594.841516] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a61bb164-6e2b-410a-8e44-09d93007519e with Priority: HIGHEST for action port [ 594.842647] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-a61bb164-6e2b-410a-8e44-09d93007519e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.842647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a61bb164-6e2b-410a-8e44-09d93007519e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.845060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a61bb164-6e2b-410a-8e44-09d93007519e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.846785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a61bb164-6e2b-410a-8e44-09d93007519e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.846785] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a61bb164-6e2b-410a-8e44-09d93007519e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.008844] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.010859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.010859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.011404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.011694] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.011834] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.012238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.012238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.012238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.012340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.012412] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.012506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.012569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.012715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.012856] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.013184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.013184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.013305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.013407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.013513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.013624] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.043408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-660ead40-fb4f-4eb7-87db-4a7944439f26 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.043408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.043408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.043690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.043690] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.043770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.043903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.044108] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.044108] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.044188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.044312] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-660ead40-fb4f-4eb7-87db-4a7944439f26 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.044401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.044458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.044643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.044747] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.044838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.044893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.045041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.045115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.045798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.045798] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.268042] env[65087]: INFO networking_nsxv3.common.synchronization [None req-ff5600cc-40e3-45af-88e5-b7e13e3a6f80 None None] Enqueued Resource ID: 5c150d44-3905-477a-888c-2aa15924c2f3 with Priority: HIGHEST for action port [ 595.268311] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c150d44-3905-477a-888c-2aa15924c2f3 with Priority: HIGHEST for action port [ 595.268958] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c150d44-3905-477a-888c-2aa15924c2f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.269086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c150d44-3905-477a-888c-2aa15924c2f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.269086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c150d44-3905-477a-888c-2aa15924c2f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.269346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c150d44-3905-477a-888c-2aa15924c2f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.269539] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c150d44-3905-477a-888c-2aa15924c2f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.349682] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a61bb164-6e2b-410a-8e44-09d93007519e [ 595.350032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.350163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.350163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.350457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.350457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.350605] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a61bb164-6e2b-410a-8e44-09d93007519e already deleted. [ 595.350783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a61bb164-6e2b-410a-8e44-09d93007519e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.517679] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b: rpc.has_security_group_logging(os_id): False [ 595.540411] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.540565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.540620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.540833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.541157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.541157] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.541323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.541323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.541462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.541498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.541911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.541911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.541911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.543038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.543142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.543348] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.543485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.543537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.544485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.544485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.544485] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b is going to be created. [ 595.551371] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 660ead40-fb4f-4eb7-87db-4a7944439f26: rpc.has_security_group_logging(os_id): False [ 595.579217] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.579217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.579217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.579217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.579217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.579463] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.579463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.579463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.580042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.580042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.580125] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.580378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.580378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.580516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.580516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.580889] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.580889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.580889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.582153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.582153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.582153] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 is going to be created. [ 595.624168] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.624168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.624346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.624449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.624649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.638514] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b in Status: IN_PROGRESS for 2s [ 595.691106] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.691106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.691106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.691106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.691106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.713077] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 in Status: IN_PROGRESS for 2s [ 595.743997] env[65087]: INFO networking_nsxv3.common.synchronization [req-5cc2a6db-267b-4e46-b587-b664c7aa1b56 req-6a0831c2-2ca3-4faa-a1a9-51565aa4059d tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 595.744554] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 595.745078] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.745388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.745514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.745784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.746026] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.746349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.746467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.746685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.746824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.746964] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.774819] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c150d44-3905-477a-888c-2aa15924c2f3 [ 595.775111] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.775531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.775531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.775644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.775644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.776096] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c150d44-3905-477a-888c-2aa15924c2f3 already deleted. [ 595.776096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c150d44-3905-477a-888c-2aa15924c2f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.900756] env[65087]: INFO networking_nsxv3.common.synchronization [None req-7b4772b0-fcee-42c4-a4ae-cf46c1de5602 None None] Enqueued Resource ID: c89c8221-8892-4630-b27c-f4946b9e4ae5 with Priority: HIGHEST for action port [ 595.900756] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c89c8221-8892-4630-b27c-f4946b9e4ae5 with Priority: HIGHEST for action port [ 595.900756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-c89c8221-8892-4630-b27c-f4946b9e4ae5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.900756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c89c8221-8892-4630-b27c-f4946b9e4ae5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.900756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c89c8221-8892-4630-b27c-f4946b9e4ae5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.900756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c89c8221-8892-4630-b27c-f4946b9e4ae5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.900756] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c89c8221-8892-4630-b27c-f4946b9e4ae5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.250445] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.250601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.250670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.250884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.250969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.251191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.251288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.251347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.251490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.251617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.251770] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 already deleted. [ 596.251871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.404363] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c89c8221-8892-4630-b27c-f4946b9e4ae5 [ 596.404595] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.404889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.404889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.405018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.405100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.405190] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c89c8221-8892-4630-b27c-f4946b9e4ae5 already deleted. [ 596.405267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c89c8221-8892-4630-b27c-f4946b9e4ae5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.522779] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.522985] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.523199] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.523416] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.523669] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.523820] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.523938] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.524339] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.524571] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.524793] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.524902] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.525092] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.525211] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.525317] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.525418] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.525543] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.545923] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.545923] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.545923] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.545923] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.546392] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.546392] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.546558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.546801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.546933] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bce95f2-f3c0-4bcd-94ea-eeb08a99237d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.027123] env[65087]: INFO networking_nsxv3.common.synchronization [None req-58ca846a-a935-4503-b580-28733a9f7bbe None None] Enqueued Resource ID: 6d38708d-a8a2-426a-a5b8-a80761637d62 with Priority: HIGHEST for action port [ 597.027682] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d38708d-a8a2-426a-a5b8-a80761637d62 with Priority: HIGHEST for action port [ 597.027968] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d38708d-a8a2-426a-a5b8-a80761637d62 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.028265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d38708d-a8a2-426a-a5b8-a80761637d62" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.028454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d38708d-a8a2-426a-a5b8-a80761637d62" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.028794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d38708d-a8a2-426a-a5b8-a80761637d62" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.028959] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d38708d-a8a2-426a-a5b8-a80761637d62',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.049049] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.049276] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.049389] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.049860] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.050314] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.050314] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 5bce95f2-f3c0-4bcd-94ea-eeb08a99237d not found, creating... [ 597.050453] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.050593] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.050710] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.050934] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.051078] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.051350] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.051498] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.051642] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.051850] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.051981] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.052512] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 5bce95f2-f3c0-4bcd-94ea-eeb08a99237d is going to be created. [ 597.073854] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.074095] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.074204] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.074453] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.074718] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.074886] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.194359] env[65087]: INFO networking_nsxv3.common.synchronization [req-7487f6c3-e2c1-4334-90ec-c7e787c67082 req-c9824d4d-d394-4322-a211-d29b8716e7d3 tempest-ImagesNegativeTestJSON-2058533762 tempest-ImagesNegativeTestJSON-2058533762-project-member] Enqueued Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGHEST for action security_group_members [ 597.194986] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGHEST for action security_group_members [ 597.196473] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-02feb9e5-0f08-496b-8186-408b46050c5d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.196727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.196727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.197537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.197808] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.197912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.197988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.198806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.198806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.198806] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.453792] env[65087]: INFO networking_nsxv3.common.synchronization [None req-7cae6b75-7da7-4ce7-84b0-71e1f5f85f61 None None] Enqueued Resource ID: 4c7cfcf0-7396-4824-82cc-73c348d777ac with Priority: HIGHEST for action port [ 597.454116] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7cfcf0-7396-4824-82cc-73c348d777ac with Priority: HIGHEST for action port [ 597.454972] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7cfcf0-7396-4824-82cc-73c348d777ac taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.455152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7cfcf0-7396-4824-82cc-73c348d777ac" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.455266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7cfcf0-7396-4824-82cc-73c348d777ac" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.455516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7cfcf0-7396-4824-82cc-73c348d777ac" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.455638] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7cfcf0-7396-4824-82cc-73c348d777ac',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.533347] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d38708d-a8a2-426a-a5b8-a80761637d62 [ 597.533347] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.533347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.533347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.533347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.533347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.533347] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d38708d-a8a2-426a-a5b8-a80761637d62 already deleted. [ 597.533347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d38708d-a8a2-426a-a5b8-a80761637d62" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.652210] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b in Status: SUCCESS [ 597.652624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.702110] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.702110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.702110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.702110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.702356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.702356] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.702445] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.702613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.702686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.702754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.702840] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02feb9e5-0f08-496b-8186-408b46050c5d already deleted. [ 597.702918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.726455] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 in Status: SUCCESS [ 597.726738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.771843] env[65087]: INFO networking_nsxv3.common.synchronization [req-5cc2a6db-267b-4e46-b587-b664c7aa1b56 req-7768a67e-bd0d-4676-9055-482d56888624 service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 597.772099] env[65087]: INFO networking_nsxv3.common.synchronization [req-5cc2a6db-267b-4e46-b587-b664c7aa1b56 req-7768a67e-bd0d-4676-9055-482d56888624 service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 597.772874] env[65087]: INFO networking_nsxv3.common.synchronization [req-5cc2a6db-267b-4e46-b587-b664c7aa1b56 req-7768a67e-bd0d-4676-9055-482d56888624 service nova] Enqueued Resource ID: 5bce95f2-f3c0-4bcd-94ea-eeb08a99237d with Priority: HIGHEST for action port [ 597.772874] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 597.773063] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 597.773128] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bce95f2-f3c0-4bcd-94ea-eeb08a99237d with Priority: HIGHEST for action port [ 597.773456] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.773621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.773885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.773980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.774157] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.775009] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.775217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.775217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.775380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.775525] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.775628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.775692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.775832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.775915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.776010] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.779188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.779188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.779188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.779188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.779188] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bce95f2-f3c0-4bcd-94ea-eeb08a99237d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.963299] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c7cfcf0-7396-4824-82cc-73c348d777ac [ 597.963299] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.963299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.963299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.963299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.963299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.963299] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c7cfcf0-7396-4824-82cc-73c348d777ac already deleted. [ 597.963299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7cfcf0-7396-4824-82cc-73c348d777ac" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.172912] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-661 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.173666] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-661" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.173666] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-661" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.173666] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-661" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.173849] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.174036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.174156] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.174762] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.174762] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.176564] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.176564] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.176564] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.177636] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.177766] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.177863] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.177990] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.199139] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.199139] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.199139] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.199139] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-661" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.199139] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.199139] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.199139] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.199139] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.199139] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.281767] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.287504] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bce95f2-f3c0-4bcd-94ea-eeb08a99237d with status ACTIVE [ 598.287504] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.287504] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.287504] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.287504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.288575] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bce95f2-f3c0-4bcd-94ea-eeb08a99237d is going to be updated. [ 598.289250] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.313027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.314460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.314460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.314460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.314460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.314460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bce95f2-f3c0-4bcd-94ea-eeb08a99237d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.426628] env[65087]: INFO networking_nsxv3.common.synchronization [None req-f6b1f7f7-ec24-4c72-a9e9-34955f0566e0 None None] Enqueued Resource ID: 56c82988-5c34-4487-b5a9-f732adf98c99 with Priority: HIGHEST for action port [ 598.427194] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c82988-5c34-4487-b5a9-f732adf98c99 with Priority: HIGHEST for action port [ 598.428076] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-56c82988-5c34-4487-b5a9-f732adf98c99 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.428076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56c82988-5c34-4487-b5a9-f732adf98c99" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.428211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56c82988-5c34-4487-b5a9-f732adf98c99" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.428463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56c82988-5c34-4487-b5a9-f732adf98c99" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.428543] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c82988-5c34-4487-b5a9-f732adf98c99',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.705427] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.705683] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.705805] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.706089] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.706393] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.706393] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9 not found, creating... [ 598.706781] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.706938] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.707061] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.707313] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.707486] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.707800] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.707956] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.708078] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.708286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.708412] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.708543] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9 is going to be created. [ 598.729412] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.729645] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.729809] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.730045] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.730368] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.730660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.792602] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.838495] env[65087]: INFO networking_nsxv3.common.synchronization [None req-123cfddf-a106-4e40-b425-3f040f8ea325 None None] Enqueued Resource ID: 11c8e548-3453-45fc-bed9-43539b2ecaa8 with Priority: HIGHEST for action port [ 598.838495] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11c8e548-3453-45fc-bed9-43539b2ecaa8 with Priority: HIGHEST for action port [ 598.838495] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-11c8e548-3453-45fc-bed9-43539b2ecaa8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.838495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11c8e548-3453-45fc-bed9-43539b2ecaa8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.838495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11c8e548-3453-45fc-bed9-43539b2ecaa8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.838495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11c8e548-3453-45fc-bed9-43539b2ecaa8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.838495] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11c8e548-3453-45fc-bed9-43539b2ecaa8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.931580] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56c82988-5c34-4487-b5a9-f732adf98c99 [ 598.931911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.932101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.932165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.932329] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.932423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.932515] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56c82988-5c34-4487-b5a9-f732adf98c99 already deleted. [ 598.932594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56c82988-5c34-4487-b5a9-f732adf98c99" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.295500] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.296210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.296210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.296210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.296210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.297994] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be created. [ 599.339950] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.339950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.339950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.339950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.339950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.340306] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11c8e548-3453-45fc-bed9-43539b2ecaa8 [ 599.340306] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.340476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.340476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.340588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.340688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.340757] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11c8e548-3453-45fc-bed9-43539b2ecaa8 already deleted. [ 599.340840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11c8e548-3453-45fc-bed9-43539b2ecaa8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.357051] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: UNINITIALIZED for 2s [ 599.505101] env[65087]: INFO networking_nsxv3.common.synchronization [req-7487f6c3-e2c1-4334-90ec-c7e787c67082 req-150d54fa-bbdc-48de-9613-1702dcfe3862 service nova] Enqueued Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGHEST for action security_group_rules [ 599.505177] env[65087]: INFO networking_nsxv3.common.synchronization [req-7487f6c3-e2c1-4334-90ec-c7e787c67082 req-150d54fa-bbdc-48de-9613-1702dcfe3862 service nova] Enqueued Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGHEST for action security_group_members [ 599.505253] env[65087]: INFO networking_nsxv3.common.synchronization [req-7487f6c3-e2c1-4334-90ec-c7e787c67082 req-150d54fa-bbdc-48de-9613-1702dcfe3862 service nova] Enqueued Resource ID: e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9 with Priority: HIGHEST for action port [ 599.505480] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGHEST for action security_group_rules [ 599.506446] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGHEST for action security_group_members [ 599.506446] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9 with Priority: HIGHEST for action port [ 599.506446] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02feb9e5-0f08-496b-8186-408b46050c5d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.509889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.509987] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.510255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.511296] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.512235] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-02feb9e5-0f08-496b-8186-408b46050c5d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.512381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.512590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.513145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.513145] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.513717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.513788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.513976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.514165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.514250] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.517354] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.517490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.517553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.517676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.517756] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.000992] env[65087]: INFO networking_nsxv3.common.synchronization [None req-8faf4f51-8099-4c67-b295-f1e9931d84f4 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_rules [ 600.002041] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_rules [ 600.002041] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75619e08-1842-4450-8de1-688a542e6f15 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.003171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.003286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.005405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.005558] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.013227] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-02feb9e5-0f08-496b-8186-408b46050c5d taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.013950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.020078] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.022266] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9 with status ACTIVE [ 600.022643] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.022837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.023334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.024136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.024283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.024425] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.024609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.024609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.024815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.024815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.024994] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.025177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.025243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.025388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.025494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.025558] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9 is going to be updated. [ 600.053329] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.053481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.053553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.053782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.053927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.054107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2b7c34a-7de6-4c4c-9403-bcfeb61a86d9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.283258] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5fe1c0b3-354a-4a00-9923-b94c76b8e4d2 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_rules [ 600.283820] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_rules [ 600.284176] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75619e08-1842-4450-8de1-688a542e6f15 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.284297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.358870] env[65087]: INFO networking_nsxv3.common.synchronization [None req-da673c1f-5cd7-4385-b113-da5579f465c9 None None] Enqueued Resource ID: 762fa27d-06dd-4678-b0c6-7fb2f98e1699 with Priority: HIGHEST for action port [ 600.359963] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762fa27d-06dd-4678-b0c6-7fb2f98e1699 with Priority: HIGHEST for action port [ 600.360449] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-762fa27d-06dd-4678-b0c6-7fb2f98e1699 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.360734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-762fa27d-06dd-4678-b0c6-7fb2f98e1699" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.361158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-762fa27d-06dd-4678-b0c6-7fb2f98e1699" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.362450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-762fa27d-06dd-4678-b0c6-7fb2f98e1699" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.362652] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('762fa27d-06dd-4678-b0c6-7fb2f98e1699',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.525595] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.530704] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.531017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.531172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.531855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.531855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.531855] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75619e08-1842-4450-8de1-688a542e6f15 already deleted. [ 600.531855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.532772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.532772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.532772] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.714962] env[65087]: INFO networking_nsxv3.common.synchronization [None req-fb01ed40-f2ce-461c-9b49-4a888645519a None None] Enqueued Resource ID: d5a021b1-decb-4d3c-8171-d2b9df7ea66e with Priority: HIGHEST for action port [ 600.715588] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5a021b1-decb-4d3c-8171-d2b9df7ea66e with Priority: HIGHEST for action port [ 600.715790] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5a021b1-decb-4d3c-8171-d2b9df7ea66e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.715910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5a021b1-decb-4d3c-8171-d2b9df7ea66e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.715978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5a021b1-decb-4d3c-8171-d2b9df7ea66e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.716250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5a021b1-decb-4d3c-8171-d2b9df7ea66e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.716329] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5a021b1-decb-4d3c-8171-d2b9df7ea66e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.865160] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 762fa27d-06dd-4678-b0c6-7fb2f98e1699 [ 600.865413] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.865776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.865776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.866212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.866212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.866212] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:762fa27d-06dd-4678-b0c6-7fb2f98e1699 already deleted. [ 600.866212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-762fa27d-06dd-4678-b0c6-7fb2f98e1699" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.028773] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.028773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.028773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.028773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.029181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.029181] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02feb9e5-0f08-496b-8186-408b46050c5d is going to be created. [ 601.057353] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.057506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.057571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.057786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.058874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.072012] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02feb9e5-0f08-496b-8186-408b46050c5d in Status: UNINITIALIZED for 2s [ 601.077203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.077203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.077203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.077427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.077427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.077427] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75619e08-1842-4450-8de1-688a542e6f15 already deleted. [ 601.077527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.218118] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5a021b1-decb-4d3c-8171-d2b9df7ea66e [ 601.218367] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.218753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.218753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.218891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.219097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.219252] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5a021b1-decb-4d3c-8171-d2b9df7ea66e already deleted. [ 601.219252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5a021b1-decb-4d3c-8171-d2b9df7ea66e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.326486] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7f82d4a-426c-46e1-aed3-ecaf1e14a9fb req-f1903426-d666-4b7c-bc4c-0952c3d34d36 tempest-ServersAdminNegativeTestJSON-2073613632 tempest-ServersAdminNegativeTestJSON-2073613632-project-member] Enqueued Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 601.327885] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 601.329403] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.329576] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.329630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.329912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.330088] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.330190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.331467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.334035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.334035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.334035] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.367634] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 601.367634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.367634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.367993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.367993] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.368104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.368363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.368363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.368450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.368450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.368553] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.756334] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.757193] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.757193] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.757193] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.757584] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.757584] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.757584] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.757926] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.757926] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.758340] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.758465] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.758596] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.758739] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.758859] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.758960] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.759101] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.779750] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.780038] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.780129] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.780293] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.780791] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-86f2f0b4-dbeb-44b2-b003-362c138ead14 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.780980] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-86f2f0b4-dbeb-44b2-b003-362c138ead14" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.781125] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-86f2f0b4-dbeb-44b2-b003-362c138ead14" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.781576] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-86f2f0b4-dbeb-44b2-b003-362c138ead14" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.781750] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86f2f0b4-dbeb-44b2-b003-362c138ead14',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.834471] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.834630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.834704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.834916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.835020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.835218] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.835318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.835382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.835540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.835619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.835706] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c already deleted. [ 601.835783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.871560] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.871797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.871901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.872476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.872476] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.872849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.872849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.872849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.872849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.872990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.873599] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.873599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.873599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.873599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.873599] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.873599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.873955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.873955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.873955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.873955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.874092] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.284875] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.284997] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.285290] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.285677] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.285945] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.286236] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 86f2f0b4-dbeb-44b2-b003-362c138ead14 not found, creating... [ 602.286693] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.286898] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.287046] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.287318] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.287482] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.287805] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.288580] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.288765] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.289353] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.289353] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.289353] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 86f2f0b4-dbeb-44b2-b003-362c138ead14 is going to be created. [ 602.314161] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.314846] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.314846] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.314846] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.315110] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.315196] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-86f2f0b4-dbeb-44b2-b003-362c138ead14" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.351286] env[65087]: INFO networking_nsxv3.common.synchronization [None req-f8121f49-86da-48c4-8433-2d31c7114019 None None] Enqueued Resource ID: a88153d8-1190-4396-887e-212c9283f1e5 with Priority: HIGHEST for action port [ 602.351935] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a88153d8-1190-4396-887e-212c9283f1e5 with Priority: HIGHEST for action port [ 602.356085] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-a88153d8-1190-4396-887e-212c9283f1e5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.356218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a88153d8-1190-4396-887e-212c9283f1e5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.356292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a88153d8-1190-4396-887e-212c9283f1e5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.356631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a88153d8-1190-4396-887e-212c9283f1e5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.356718] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a88153d8-1190-4396-887e-212c9283f1e5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.378122] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0af2af-9718-4a7b-876d-92e1124cdbd2: rpc.has_security_group_logging(os_id): False [ 602.399021] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.399021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.399021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.399021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.399021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.399021] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.399021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.399021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.399021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.399021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.399532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.399532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.399632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.399747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.399907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.401837] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.402069] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.402280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.402499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.402592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.402692] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be created. [ 602.512437] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.512437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.512437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.512437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.512437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.525057] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 602.860750] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a88153d8-1190-4396-887e-212c9283f1e5 [ 602.860823] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.860966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.861042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.861662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.861662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.861662] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a88153d8-1190-4396-887e-212c9283f1e5 already deleted. [ 602.861662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a88153d8-1190-4396-887e-212c9283f1e5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.043964] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7f82d4a-426c-46e1-aed3-ecaf1e14a9fb req-1fee7a77-5925-4143-ac71-777d5ad95c61 service nova] Enqueued Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_rules [ 603.045883] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7f82d4a-426c-46e1-aed3-ecaf1e14a9fb req-1fee7a77-5925-4143-ac71-777d5ad95c61 service nova] Enqueued Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 603.046474] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7f82d4a-426c-46e1-aed3-ecaf1e14a9fb req-1fee7a77-5925-4143-ac71-777d5ad95c61 service nova] Enqueued Resource ID: 86f2f0b4-dbeb-44b2-b003-362c138ead14 with Priority: HIGHEST for action port [ 603.046901] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_rules [ 603.046901] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 603.047107] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86f2f0b4-dbeb-44b2-b003-362c138ead14 with Priority: HIGHEST for action port [ 603.047261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.047406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.047406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.047734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.047820] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.049519] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.049519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.049519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.049519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.049519] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.049519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.049519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.049519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.050142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.050142] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.050458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-86f2f0b4-dbeb-44b2-b003-362c138ead14 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.050555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86f2f0b4-dbeb-44b2-b003-362c138ead14" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.050617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86f2f0b4-dbeb-44b2-b003-362c138ead14" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.051366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86f2f0b4-dbeb-44b2-b003-362c138ead14" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.051366] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86f2f0b4-dbeb-44b2-b003-362c138ead14',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.082998] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02feb9e5-0f08-496b-8186-408b46050c5d in Status: SUCCESS [ 603.082998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.084087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.084228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.085007] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.085007] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.085007] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.085007] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.085007] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.085242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.085242] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.553507] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.554545] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.554657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.555015] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86f2f0b4-dbeb-44b2-b003-362c138ead14 with status ACTIVE [ 603.555183] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.555291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.555366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.555688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.555889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.558532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.558532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.558532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.558532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.558532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.558532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.558532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.558532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.558532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.558532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.558532] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86f2f0b4-dbeb-44b2-b003-362c138ead14 is going to be updated. [ 603.579726] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.579888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.580038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.580216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.580361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.580540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86f2f0b4-dbeb-44b2-b003-362c138ead14" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.587723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-02feb9e5-0f08-496b-8186-408b46050c5d taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.587866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.587939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.588171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.588341] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.588438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.588501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.588641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.588721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.588957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.588957] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-02feb9e5-0f08-496b-8186-408b46050c5d taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.589365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.589435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.589854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.590044] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.590171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.590237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.590384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.590464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.590550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.590641] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.055529] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.096908] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02feb9e5-0f08-496b-8186-408b46050c5d: rpc.has_security_group_logging(os_id): False [ 604.118299] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.118466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.118466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.119487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.119598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.119851] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.119990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.120074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.120302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.120487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.120556] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.120637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.120693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.120838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.120917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.121269] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.121365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.121610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.121610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.121797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.121797] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02feb9e5-0f08-496b-8186-408b46050c5d is going to be created. [ 604.190344] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.190551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.190600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.190858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.191127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.203466] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02feb9e5-0f08-496b-8186-408b46050c5d in Status: IN_PROGRESS for 2s [ 604.323961] env[65087]: INFO networking_nsxv3.common.synchronization [None req-0cd3811d-2d4d-4111-8873-5c930cbcb2c4 None None] Enqueued Resource ID: 66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2 with Priority: HIGHEST for action port [ 604.326017] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2 with Priority: HIGHEST for action port [ 604.326017] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.326175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.326248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.326624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.326732] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.545432] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 604.545432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.559226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.560032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.560032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.560032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.560032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.560032] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c is going to be created. [ 604.595043] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.595043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.595043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.595043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.595043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.610447] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: UNINITIALIZED for 2s [ 604.673980] env[65087]: INFO networking_nsxv3.common.synchronization [None req-4569644a-812a-4cff-9562-f7104001ab3d None None] Enqueued Resource ID: df61ee51-beac-435b-955a-6a73b6e27f5c with Priority: HIGHEST for action port [ 604.674660] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df61ee51-beac-435b-955a-6a73b6e27f5c with Priority: HIGHEST for action port [ 604.675030] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-df61ee51-beac-435b-955a-6a73b6e27f5c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.675169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df61ee51-beac-435b-955a-6a73b6e27f5c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.675238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df61ee51-beac-435b-955a-6a73b6e27f5c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.675507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df61ee51-beac-435b-955a-6a73b6e27f5c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.675596] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df61ee51-beac-435b-955a-6a73b6e27f5c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.832338] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2 [ 604.832585] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.832756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.832831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.833153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.833153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.833230] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2 already deleted. [ 604.833315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66d6d9e3-1bed-4cd0-a64c-ab5bb04fb7c2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.982263] env[65087]: INFO networking_nsxv3.common.synchronization [req-d874e40b-f518-4553-8dca-1749abab2d48 req-54393f2a-b2cc-465a-9992-9c129f310307 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 604.982263] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 604.982263] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.982263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.982263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.984569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.984569] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.986119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.986119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.986119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.986119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.986119] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.007850] env[65087]: INFO networking_nsxv3.common.synchronization [None req-2204e54f-9b20-4b57-b151-17057e917c1f None None] Enqueued Resource ID: ad057454-30b4-4b40-893b-bf484ce665a6 with Priority: HIGHEST for action port [ 605.007850] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad057454-30b4-4b40-893b-bf484ce665a6 with Priority: HIGHEST for action port [ 605.008289] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad057454-30b4-4b40-893b-bf484ce665a6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.008458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad057454-30b4-4b40-893b-bf484ce665a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.010886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad057454-30b4-4b40-893b-bf484ce665a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.010886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad057454-30b4-4b40-893b-bf484ce665a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.010886] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad057454-30b4-4b40-893b-bf484ce665a6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.177554] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df61ee51-beac-435b-955a-6a73b6e27f5c [ 605.177860] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.178168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.178168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.178613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.178613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.178717] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df61ee51-beac-435b-955a-6a73b6e27f5c already deleted. [ 605.178747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df61ee51-beac-435b-955a-6a73b6e27f5c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.392935] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-488 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.393151] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-488" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.393201] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-488" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.393536] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-488" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.393794] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.393947] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.395457] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.395764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.395918] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.396141] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.396261] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.396363] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.396465] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.396568] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.396663] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.396791] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.418061] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.418577] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.418577] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.418730] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-488" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.419056] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-ef2ae025-7e74-42db-812c-dded1cafc1cf taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.419232] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.419339] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.419749] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.421256] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2ae025-7e74-42db-812c-dded1cafc1cf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.488923] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.489288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.492039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.492039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.492039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.492039] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.492039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.492039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.493117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.493117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.493117] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 already deleted. [ 605.493117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.512580] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad057454-30b4-4b40-893b-bf484ce665a6 [ 605.512580] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.512737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.512737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.512961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.513089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.513191] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad057454-30b4-4b40-893b-bf484ce665a6 already deleted. [ 605.514399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad057454-30b4-4b40-893b-bf484ce665a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.925073] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.925574] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.925574] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.925665] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.925806] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.925994] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port ef2ae025-7e74-42db-812c-dded1cafc1cf not found, creating... [ 605.926241] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.926466] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.926566] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.926719] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.926847] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.927168] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.927294] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.927403] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.927603] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.927809] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.927954] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: ef2ae025-7e74-42db-812c-dded1cafc1cf is going to be created. [ 605.954876] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.955227] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.955462] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.955860] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.956220] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.956564] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.227330] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02feb9e5-0f08-496b-8186-408b46050c5d in Status: SUCCESS [ 606.227657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.623842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: SUCCESS [ 606.623942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.625388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.625388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.625388] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.625388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.625388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.625388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.625388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.625388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.625388] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.724649] env[65087]: INFO networking_nsxv3.common.synchronization [req-d874e40b-f518-4553-8dca-1749abab2d48 req-a4bc785b-4b10-4930-9a5e-bb1525de1ec3 service nova] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 606.724833] env[65087]: INFO networking_nsxv3.common.synchronization [req-d874e40b-f518-4553-8dca-1749abab2d48 req-a4bc785b-4b10-4930-9a5e-bb1525de1ec3 service nova] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 606.725050] env[65087]: INFO networking_nsxv3.common.synchronization [req-d874e40b-f518-4553-8dca-1749abab2d48 req-a4bc785b-4b10-4930-9a5e-bb1525de1ec3 service nova] Enqueued Resource ID: ef2ae025-7e74-42db-812c-dded1cafc1cf with Priority: HIGHEST for action port [ 606.725235] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 606.725363] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 606.725460] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2ae025-7e74-42db-812c-dded1cafc1cf with Priority: HIGHEST for action port [ 606.726011] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.726722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.726800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.727076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.727159] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.727972] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.728298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.728298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.728412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.728561] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.728656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.728720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.728862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.728976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.729045] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.733203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2ae025-7e74-42db-812c-dded1cafc1cf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.733203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.733203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.733203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.733203] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2ae025-7e74-42db-812c-dded1cafc1cf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.130762] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.131093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.131093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.131231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.131398] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.131503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.131565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.131712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.131857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.131965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.132093] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.132184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.132243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.132385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.132545] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.132634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.132692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.134105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.134105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.134105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.134105] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.233794] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.233935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.234923] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.235185] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef2ae025-7e74-42db-812c-dded1cafc1cf with status ACTIVE [ 607.235332] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.235439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.235497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.235667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.235766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.235910] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.236016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.236080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.236232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.236415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.237062] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.237361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.237452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.237597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.237941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.237941] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef2ae025-7e74-42db-812c-dded1cafc1cf is going to be updated. [ 607.262993] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.264939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.265086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.265309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.265460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.265805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.639970] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fb66ad5-69f7-466f-94b1-24f53af1b70c: rpc.has_security_group_logging(os_id): False [ 607.659942] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.659942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.660161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.660582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.660710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.661099] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.661099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.661233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.661311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.661362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.661896] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.662049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.662680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.662680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.662680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.662680] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.662680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.663082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.663082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.663082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.663177] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c is going to be created. [ 607.734028] env[65087]: INFO networking_nsxv3.common.synchronization [None req-023c92a4-1b65-439c-9b54-305fe8a98327 tempest-ServersTestFqdnHostnames-2087557967 tempest-ServersTestFqdnHostnames-2087557967-project-member] Enqueued Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_rules [ 607.734028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.734028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.736130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.736407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.736600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.738027] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_rules [ 607.738361] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.738476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.738541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.738779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.738863] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.741714] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.753907] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: IN_PROGRESS for 2s [ 607.867284] env[65087]: INFO networking_nsxv3.common.synchronization [None req-335bece7-68f6-4f91-9730-ed9a04a62c21 tempest-ServersTestFqdnHostnames-2087557967 tempest-ServersTestFqdnHostnames-2087557967-project-member] Enqueued Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_rules [ 607.867840] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_rules [ 607.868163] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.868277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.247148] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.247148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.247148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.247148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.247148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.247968] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be created. [ 608.274664] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.274664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.274664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.274664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.274664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.274664] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb already deleted. [ 608.274664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.274664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.274664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.274664] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.284901] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.285196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.285196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.286015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.286015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.305702] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: UNINITIALIZED for 2s [ 608.803517] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.803697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.803769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.803955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.804685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.804833] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb already deleted. [ 608.804936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.972838] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c0133071-3809-4e63-95c2-03d8be43ac46 None None] Enqueued Resource ID: b7f0da7b-7a49-42f8-a804-b9c40ab8b570 with Priority: HIGHEST for action port [ 608.973835] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7f0da7b-7a49-42f8-a804-b9c40ab8b570 with Priority: HIGHEST for action port [ 608.975682] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7f0da7b-7a49-42f8-a804-b9c40ab8b570 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.975845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7f0da7b-7a49-42f8-a804-b9c40ab8b570" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.975915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7f0da7b-7a49-42f8-a804-b9c40ab8b570" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.976270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7f0da7b-7a49-42f8-a804-b9c40ab8b570" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.976386] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f0da7b-7a49-42f8-a804-b9c40ab8b570',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.421183] env[65087]: INFO networking_nsxv3.common.synchronization [None req-45c58866-8052-44b8-a9ed-6729248b2d9e None None] Enqueued Resource ID: cc0e39cc-411d-4266-b5f1-569b22d6e769 with Priority: HIGHEST for action port [ 609.421183] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc0e39cc-411d-4266-b5f1-569b22d6e769 with Priority: HIGHEST for action port [ 609.421183] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc0e39cc-411d-4266-b5f1-569b22d6e769 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.421732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc0e39cc-411d-4266-b5f1-569b22d6e769" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.421732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc0e39cc-411d-4266-b5f1-569b22d6e769" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.423138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc0e39cc-411d-4266-b5f1-569b22d6e769" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.423138] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc0e39cc-411d-4266-b5f1-569b22d6e769',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.480542] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7f0da7b-7a49-42f8-a804-b9c40ab8b570 [ 609.480542] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.480542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.480542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.480542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.480542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.480542] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7f0da7b-7a49-42f8-a804-b9c40ab8b570 already deleted. [ 609.480542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7f0da7b-7a49-42f8-a804-b9c40ab8b570" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.767114] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: SUCCESS [ 609.767322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.925821] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc0e39cc-411d-4266-b5f1-569b22d6e769 [ 609.926204] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.926431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.926553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.926906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.927092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.927212] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc0e39cc-411d-4266-b5f1-569b22d6e769 already deleted. [ 609.927340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc0e39cc-411d-4266-b5f1-569b22d6e769" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.317820] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 610.318074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.318755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.318755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.318755] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.319032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.319032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.319120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.319120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.319216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.319307] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.823498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.823498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.823498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.823498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.824298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.824298] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.824298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.824298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.824575] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.824701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.824834] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.824984] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.243542] env[65087]: INFO networking_nsxv3.common.synchronization [req-12d51f35-f028-4153-a904-d78db666839d req-1fb8468b-9eff-48a7-b9fe-ff3dd4625ec0 tempest-VolumesAssistedSnapshotsTest-1625343650 tempest-VolumesAssistedSnapshotsTest-1625343650-project-member] Enqueued Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_members [ 611.243542] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_members [ 611.243542] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0521b23b-9dcc-40b0-a1c4-32590b372bcd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.243542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.243723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.243823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.244168] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.244168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.244168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.244498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.244498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.244601] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.328177] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3c0a5a-197c-4c4c-a82b-9342302fe922: rpc.has_security_group_logging(os_id): False [ 611.349051] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.349051] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.349051] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.349051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.350292] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.350661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.350899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.351448] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.351888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.352629] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be created. [ 611.421149] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.421149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.421149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.421149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.421149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.444278] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 611.729801] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-572 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.729801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-572" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.729801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-572" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.730187] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-572" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.730476] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.730663] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.730791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.730993] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.731150] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.731366] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.731475] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.731578] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.731680] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.731781] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.731925] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.732152] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.747486] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.747648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.747727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.748016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.748155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.748356] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.748509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.748509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.749033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.749278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.749428] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd already deleted. [ 611.749523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.761651] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.762181] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.762373] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.762558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-572" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.763041] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-dbb5b936-ba22-4c51-80e1-be373a0f6f17 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.763258] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-dbb5b936-ba22-4c51-80e1-be373a0f6f17" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.763389] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-dbb5b936-ba22-4c51-80e1-be373a0f6f17" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.763745] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-dbb5b936-ba22-4c51-80e1-be373a0f6f17" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.763911] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbb5b936-ba22-4c51-80e1-be373a0f6f17',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.268539] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.268932] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.268932] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.269350] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.269350] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.269470] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port dbb5b936-ba22-4c51-80e1-be373a0f6f17 not found, creating... [ 612.269722] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.269875] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.269986] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.270213] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.270343] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.270625] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.270776] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.270914] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.271548] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.272446] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.272736] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: dbb5b936-ba22-4c51-80e1-be373a0f6f17 is going to be created. [ 612.313362] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.313589] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.313711] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.314127] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.314257] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.314489] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-dbb5b936-ba22-4c51-80e1-be373a0f6f17" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.023975] env[65087]: INFO networking_nsxv3.common.synchronization [req-12d51f35-f028-4153-a904-d78db666839d req-81fba0b3-9854-4b25-973a-392a29494618 service nova] Enqueued Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_rules [ 613.023975] env[65087]: INFO networking_nsxv3.common.synchronization [req-12d51f35-f028-4153-a904-d78db666839d req-81fba0b3-9854-4b25-973a-392a29494618 service nova] Enqueued Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_members [ 613.024259] env[65087]: INFO networking_nsxv3.common.synchronization [req-12d51f35-f028-4153-a904-d78db666839d req-81fba0b3-9854-4b25-973a-392a29494618 service nova] Enqueued Resource ID: dbb5b936-ba22-4c51-80e1-be373a0f6f17 with Priority: HIGHEST for action port [ 613.025087] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_rules [ 613.025297] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_members [ 613.025737] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb5b936-ba22-4c51-80e1-be373a0f6f17 with Priority: HIGHEST for action port [ 613.026591] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.026591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.026591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.026591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.028820] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.028820] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0521b23b-9dcc-40b0-a1c4-32590b372bcd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.028820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.028820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.028820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.028820] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.028820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.028820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.029625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.029625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.029625] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.030815] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbb5b936-ba22-4c51-80e1-be373a0f6f17 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.030938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbb5b936-ba22-4c51-80e1-be373a0f6f17" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.031012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbb5b936-ba22-4c51-80e1-be373a0f6f17" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.031191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbb5b936-ba22-4c51-80e1-be373a0f6f17" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.031262] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbb5b936-ba22-4c51-80e1-be373a0f6f17',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.291599] env[65087]: INFO networking_nsxv3.common.synchronization [None req-20e587ac-fa0b-4e2d-bc34-6f89d391487f None None] Enqueued Resource ID: fb0c0a52-2da2-46fb-81a4-b960fd24f7eb with Priority: HIGHEST for action port [ 613.291599] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0c0a52-2da2-46fb-81a4-b960fd24f7eb with Priority: HIGHEST for action port [ 613.292109] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb0c0a52-2da2-46fb-81a4-b960fd24f7eb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.292369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb0c0a52-2da2-46fb-81a4-b960fd24f7eb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.292369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb0c0a52-2da2-46fb-81a4-b960fd24f7eb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.292438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb0c0a52-2da2-46fb-81a4-b960fd24f7eb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.292531] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb0c0a52-2da2-46fb-81a4-b960fd24f7eb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.445211] env[65087]: INFO networking_nsxv3.common.synchronization [req-1c8dedcb-05cb-46ca-a66c-6afcb0b7aa99 req-9ec67bab-b4b2-462a-8053-9cc208de0f8d tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 613.447879] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 613.447879] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.447879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.447879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.447879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.448099] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.448157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.448201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.448366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.448777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.448777] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.460672] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 613.460890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.536760] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.541031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0521b23b-9dcc-40b0-a1c4-32590b372bcd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.541031] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbb5b936-ba22-4c51-80e1-be373a0f6f17 with status ACTIVE [ 613.541031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.541031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.541031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.541031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.541818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.546674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.546674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.546834] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.546834] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbb5b936-ba22-4c51-80e1-be373a0f6f17 is going to be updated. [ 613.570236] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.570383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.570468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.570681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.571391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.571391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbb5b936-ba22-4c51-80e1-be373a0f6f17" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.796686] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb0c0a52-2da2-46fb-81a4-b960fd24f7eb [ 613.796686] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.796686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.796686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.796686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.796686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.796686] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb0c0a52-2da2-46fb-81a4-b960fd24f7eb already deleted. [ 613.796686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb0c0a52-2da2-46fb-81a4-b960fd24f7eb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.863742] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-365 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.863742] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-365" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.863742] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-365" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.863742] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-365" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.864256] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.864475] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.864636] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.864911] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.865145] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.865419] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.865597] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.865748] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.865895] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.866061] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.866215] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.866386] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.886842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.886842] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.887678] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.887914] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-365" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.888440] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.888804] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.888938] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.889347] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.889452] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cba7e19e-a17d-4ce4-85a5-b268b9debdbf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.951954] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.952120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.952158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.952357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.952455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.952651] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.952756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.952854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.953026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.953104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.953204] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 already deleted. [ 613.953264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.040720] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.394678] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.394678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.394678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.394678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.394678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.394678] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port cba7e19e-a17d-4ce4-85a5-b268b9debdbf not found, creating... [ 614.394678] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.394678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.394678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.394678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.394678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.395611] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.395611] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.395611] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.395611] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.395611] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.395611] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf is going to be created. [ 614.418663] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.419031] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.419226] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.419614] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.420084] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.420430] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.544735] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.545327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.545491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.545912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.546118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.546297] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd is going to be created. [ 614.578628] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.578628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.578628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.578628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.579272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.599301] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd in Status: UNINITIALIZED for 2s [ 615.127706] env[65087]: INFO networking_nsxv3.common.synchronization [None req-301347d6-c6ea-4615-84dc-1d029d68692a None None] Enqueued Resource ID: 50aae7c7-ef01-49d5-89cb-58e4458170e4 with Priority: HIGHEST for action port [ 615.128827] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50aae7c7-ef01-49d5-89cb-58e4458170e4 with Priority: HIGHEST for action port [ 615.129446] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-50aae7c7-ef01-49d5-89cb-58e4458170e4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.129619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50aae7c7-ef01-49d5-89cb-58e4458170e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.129698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50aae7c7-ef01-49d5-89cb-58e4458170e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.130122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50aae7c7-ef01-49d5-89cb-58e4458170e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.130221] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50aae7c7-ef01-49d5-89cb-58e4458170e4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.182241] env[65087]: INFO networking_nsxv3.common.synchronization [req-1c8dedcb-05cb-46ca-a66c-6afcb0b7aa99 req-fc3fdddf-1564-4b31-85a8-d438809f05f0 service nova] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_rules [ 615.182460] env[65087]: INFO networking_nsxv3.common.synchronization [req-1c8dedcb-05cb-46ca-a66c-6afcb0b7aa99 req-fc3fdddf-1564-4b31-85a8-d438809f05f0 service nova] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 615.182589] env[65087]: INFO networking_nsxv3.common.synchronization [req-1c8dedcb-05cb-46ca-a66c-6afcb0b7aa99 req-fc3fdddf-1564-4b31-85a8-d438809f05f0 service nova] Enqueued Resource ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf with Priority: HIGHEST for action port [ 615.184206] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_rules [ 615.184425] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 615.184586] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf with Priority: HIGHEST for action port [ 615.185037] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.185291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.186013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.186380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.186501] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.192880] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.193059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.193130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.193377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.193553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.193657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.193719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.193874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.193959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.194080] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.195209] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.195337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.195387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.195555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.195631] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cba7e19e-a17d-4ce4-85a5-b268b9debdbf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.635915] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50aae7c7-ef01-49d5-89cb-58e4458170e4 [ 615.635915] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.635915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.635915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.635915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.635915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.635915] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50aae7c7-ef01-49d5-89cb-58e4458170e4 already deleted. [ 615.635915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50aae7c7-ef01-49d5-89cb-58e4458170e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.699216] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.699587] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.699587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.699587] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cba7e19e-a17d-4ce4-85a5-b268b9debdbf with status ACTIVE [ 615.699722] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.699777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.699849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.700120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.700197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.700434] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.700524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.700524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.700656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.700741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.700888] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.700985] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.702707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.702707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.705872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.705872] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf is going to be updated. [ 615.740942] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.741186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.741186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.741396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.741528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.741684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.802110] env[65087]: INFO networking_nsxv3.common.synchronization [req-8b714606-b349-4633-bf83-937a036c3e5d req-4baad802-55a4-4956-87c4-96c177887f84 tempest-FloatingIPsAssociationNegativeTestJSON-1168683800 tempest-FloatingIPsAssociationNegativeTestJSON-1168683800-project-member] Enqueued Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGHEST for action security_group_members [ 615.806505] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGHEST for action security_group_members [ 615.806801] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-56b74809-473d-4b46-a128-e8953c39feab taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.806801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.806801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.807607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.807607] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.807607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.807607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.807852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.807852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.807924] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.206597] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.288117] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-276 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.288329] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-276" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.288454] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-276" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.288915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-276" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.289165] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.289358] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.289606] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.289713] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.289822] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.290077] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.290190] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.290344] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.290433] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.290542] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.290628] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.290777] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.311172] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.311461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.311615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.311954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.312125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.312414] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.312562] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.312670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.312914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.313086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.313236] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56b74809-473d-4b46-a128-e8953c39feab already deleted. [ 616.313383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.321954] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.322273] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.322487] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.322757] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-276" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.323233] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-83161259-bf5b-411f-9490-c9ec94b150e6 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.323504] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-83161259-bf5b-411f-9490-c9ec94b150e6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.323701] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-83161259-bf5b-411f-9490-c9ec94b150e6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.324199] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-83161259-bf5b-411f-9490-c9ec94b150e6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.324446] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83161259-bf5b-411f-9490-c9ec94b150e6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.611567] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd in Status: SUCCESS [ 616.611824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.612076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.612322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.612516] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.612639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.612705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.612875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.612980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.613071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.613174] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.709663] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.709663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.709663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.710158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.710158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.710158] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be created. [ 616.741813] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.743891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.743891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.743891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.743891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.754632] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: UNINITIALIZED for 2s [ 616.828615] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.828759] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.828926] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.829171] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.829322] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.829472] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 83161259-bf5b-411f-9490-c9ec94b150e6 not found, creating... [ 616.829760] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.829926] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.830059] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.830289] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.830419] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.830687] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.830836] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.830946] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.831172] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.831434] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.831434] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 83161259-bf5b-411f-9490-c9ec94b150e6 is going to be created. [ 616.856387] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.856638] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.856799] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.857102] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.857472] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.857684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-83161259-bf5b-411f-9490-c9ec94b150e6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.115268] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.617728] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0521b23b-9dcc-40b0-a1c4-32590b372bcd: rpc.has_security_group_logging(os_id): False [ 617.652024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.652024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.652024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.652242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.652340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.652577] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.652679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.652742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.652896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.652985] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.653090] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd is going to be created. [ 617.657610] env[65087]: INFO networking_nsxv3.common.synchronization [None req-71be8aa6-cf70-43e6-8bae-4975ac99c190 tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 617.658199] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 617.658517] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.658710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.658710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.658980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.663663] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.681363] env[65087]: INFO networking_nsxv3.common.synchronization [req-8b714606-b349-4633-bf83-937a036c3e5d req-db183bf1-8682-47f4-8309-96179e6e80ad service nova] Enqueued Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGHEST for action security_group_rules [ 617.681906] env[65087]: INFO networking_nsxv3.common.synchronization [req-8b714606-b349-4633-bf83-937a036c3e5d req-db183bf1-8682-47f4-8309-96179e6e80ad service nova] Enqueued Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGHEST for action security_group_members [ 617.681906] env[65087]: INFO networking_nsxv3.common.synchronization [req-8b714606-b349-4633-bf83-937a036c3e5d req-db183bf1-8682-47f4-8309-96179e6e80ad service nova] Enqueued Resource ID: 83161259-bf5b-411f-9490-c9ec94b150e6 with Priority: HIGHEST for action port [ 617.682264] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGHEST for action security_group_rules [ 617.682405] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGHEST for action security_group_members [ 617.682698] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83161259-bf5b-411f-9490-c9ec94b150e6 with Priority: HIGHEST for action port [ 617.684032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56b74809-473d-4b46-a128-e8953c39feab taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.684032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.684231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.687262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.687395] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.688816] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-56b74809-473d-4b46-a128-e8953c39feab taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.688970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.689087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.689286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.689451] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.689594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.689715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.689961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.690434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.690434] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.692326] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-83161259-bf5b-411f-9490-c9ec94b150e6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.692326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83161259-bf5b-411f-9490-c9ec94b150e6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.692326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83161259-bf5b-411f-9490-c9ec94b150e6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.692326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83161259-bf5b-411f-9490-c9ec94b150e6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.692326] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83161259-bf5b-411f-9490-c9ec94b150e6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.745283] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.745695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.745695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.745695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.745978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.763180] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd in Status: IN_PROGRESS for 2s [ 617.922893] env[65087]: INFO networking_nsxv3.common.synchronization [None req-323f2bc6-eb97-45d6-8dea-3d83f9101fbd tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 617.923859] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 617.924827] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.925287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.189041] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.189229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.189229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.189461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.189589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.189736] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 already deleted. [ 618.189898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.190343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.190549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.190647] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.195204] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-56b74809-473d-4b46-a128-e8953c39feab taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.195204] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.197839] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.199154] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83161259-bf5b-411f-9490-c9ec94b150e6 with status ACTIVE [ 618.199368] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.199491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.199558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.199780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.199870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.200053] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.200153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.200251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.200369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.200451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.200611] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.200701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.202122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.202479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.202479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.202581] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83161259-bf5b-411f-9490-c9ec94b150e6 is going to be updated. [ 618.226888] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.227101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.227148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.227435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.227537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.227807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83161259-bf5b-411f-9490-c9ec94b150e6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.707898] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.728859] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.729743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.729743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.730175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.730276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.730376] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 already deleted. [ 618.730454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.765975] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 618.766363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.766680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.766915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.767538] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.767538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.767538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.767753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.767790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.767867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.767965] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.832798] env[65087]: INFO networking_nsxv3.common.synchronization [req-a3e15efc-aed1-4995-8e0d-237729168ff5 req-5a625b1c-76a6-45a2-a522-8761187071bd tempest-ServerDiagnosticsTest-2019665037 tempest-ServerDiagnosticsTest-2019665037-project-member] Enqueued Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGHEST for action security_group_members [ 618.833618] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGHEST for action security_group_members [ 618.834104] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.834334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.834725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.834915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.835183] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.835406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.835554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.835845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.836049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.836240] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.211528] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.211528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.211528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.211528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.211528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.211528] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56b74809-473d-4b46-a128-e8953c39feab is going to be created. [ 619.246603] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.247493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.248125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.249044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.249044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.262840] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56b74809-473d-4b46-a128-e8953c39feab in Status: UNINITIALIZED for 2s [ 619.271872] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.271872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.271872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.271872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.271872] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.271872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.271872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.271872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.271872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.271872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.272385] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.272385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.272385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.272509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.272676] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.272767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.274073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.274073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.274073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.274073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.274073] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.341680] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.342973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.342973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.342973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.342973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.343258] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.343258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.343258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.343774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.343774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.343774] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b is going to be updated. [ 619.383146] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.383256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.384181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.384181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.384181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.400162] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b in Status: IN_PROGRESS for 2s [ 619.477228] env[65087]: INFO networking_nsxv3.common.synchronization [req-7df00c33-8dbc-43ae-a3c5-4fc20f3f68ff req-ff679fb1-7b2e-4b6d-bbea-03f6b25ab1f2 tempest-ImagesNegativeTestJSON-2058533762 tempest-ImagesNegativeTestJSON-2058533762-project-member] Enqueued Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGHEST for action security_group_members [ 619.477966] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGHEST for action security_group_members [ 619.479108] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-02feb9e5-0f08-496b-8186-408b46050c5d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.479288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.479360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.479621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.479787] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.479949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.480031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.480208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.480664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.481552] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.778686] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0756d72c-9df8-4861-9190-090f401edeb6: rpc.has_security_group_logging(os_id): False [ 619.778686] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd in Status: SUCCESS [ 619.778686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.797867] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.797867] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.797867] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.797867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.799091] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.799367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.800035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.800035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.800035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.800035] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be created. [ 619.868797] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.868959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.869044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.869252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.869437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.881851] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: IN_PROGRESS for 2s [ 619.988477] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.988477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.988477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.988477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.988791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.988791] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.988881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.988978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.989182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.989293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.989293] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02feb9e5-0f08-496b-8186-408b46050c5d is going to be updated. [ 620.045142] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.045388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.045481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.046126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.046126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.068211] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02feb9e5-0f08-496b-8186-408b46050c5d in Status: IN_PROGRESS for 2s [ 620.385223] env[65087]: INFO networking_nsxv3.common.synchronization [req-e36e6f88-136b-44b7-b814-dd87c4630e7a req-599fabb7-e05c-4c61-a8a5-15c065c96937 tempest-ServersNegativeTestMultiTenantJSON-1371931673 tempest-ServersNegativeTestMultiTenantJSON-1371931673-project-member] Enqueued Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGHEST for action security_group_members [ 620.385928] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGHEST for action security_group_members [ 620.386280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9bb938-6d5d-4fc7-8385-f402075d6859 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.386416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.386470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.386856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.386977] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.387128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.387190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.387462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.387462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.387597] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.758409] env[65087]: INFO networking_nsxv3.common.synchronization [None req-f7dad050-eeef-4072-930a-1e4f694a8647 None None] Enqueued Resource ID: bb0ab012-4068-4ac6-9633-3166ace6483f with Priority: HIGHEST for action port [ 620.759130] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0ab012-4068-4ac6-9633-3166ace6483f with Priority: HIGHEST for action port [ 620.761817] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb0ab012-4068-4ac6-9633-3166ace6483f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.761817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb0ab012-4068-4ac6-9633-3166ace6483f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.761817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb0ab012-4068-4ac6-9633-3166ace6483f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.761817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb0ab012-4068-4ac6-9633-3166ace6483f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.761817] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb0ab012-4068-4ac6-9633-3166ace6483f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.892402] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.892824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.892824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.892824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.892946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.893211] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.893378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.893446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.893631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.893720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.893812] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9bb938-6d5d-4fc7-8385-f402075d6859 already deleted. [ 620.893914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.022456] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-484 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.022829] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-484" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.022829] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-484" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.023145] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-484" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.023485] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.024126] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.024126] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.024126] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.024468] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.024573] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.024718] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.025163] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.025163] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.025163] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.025163] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.025377] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.050105] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.050400] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.050518] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.050737] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-484" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.051120] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-437526b0-c107-41c3-85dc-d952f92d79b4 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.051330] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-437526b0-c107-41c3-85dc-d952f92d79b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.051453] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-437526b0-c107-41c3-85dc-d952f92d79b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.051861] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-437526b0-c107-41c3-85dc-d952f92d79b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.052945] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('437526b0-c107-41c3-85dc-d952f92d79b4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.265046] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb0ab012-4068-4ac6-9633-3166ace6483f [ 621.265046] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.265343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.265343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.265492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.265596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.265685] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb0ab012-4068-4ac6-9633-3166ace6483f already deleted. [ 621.265771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb0ab012-4068-4ac6-9633-3166ace6483f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.284626] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56b74809-473d-4b46-a128-e8953c39feab in Status: SUCCESS [ 621.284852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.285475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.285703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.285896] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.286051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.286140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.286265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.286361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.286430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.286507] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.414203] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b in Status: SUCCESS [ 621.414203] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b deletion is rescheduled due to dependency. [ 621.414203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.555768] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.556128] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.556348] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.556630] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.556782] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.556982] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 437526b0-c107-41c3-85dc-d952f92d79b4 not found, creating... [ 621.557297] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.557519] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.557669] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.557925] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.558750] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.559206] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.559406] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.559665] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.559952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.560321] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.560321] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 437526b0-c107-41c3-85dc-d952f92d79b4 is going to be created. [ 621.584215] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.585218] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.585218] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.585218] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.585218] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.585508] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-437526b0-c107-41c3-85dc-d952f92d79b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.791819] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-56b74809-473d-4b46-a128-e8953c39feab taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.792197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.792508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.792759] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.792894] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.793101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.793225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.793491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.793709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.793793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.794074] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-56b74809-473d-4b46-a128-e8953c39feab taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.794275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.794357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.794524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.794706] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.794836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.794909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.795028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.795113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.795211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.795391] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.896067] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 621.896449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.081875] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02feb9e5-0f08-496b-8186-408b46050c5d in Status: SUCCESS [ 622.081875] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02feb9e5-0f08-496b-8186-408b46050c5d deletion is rescheduled due to dependency. [ 622.081875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.298164] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 56b74809-473d-4b46-a128-e8953c39feab: rpc.has_security_group_logging(os_id): False [ 622.318030] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.318272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.318272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.318477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.318588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.318750] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.318967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.318967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.319081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.319147] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.319381] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.319486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.319550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.319717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.319793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.320111] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.320111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.320275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.320275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.320370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.320413] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56b74809-473d-4b46-a128-e8953c39feab is going to be created. [ 622.347569] env[65087]: INFO networking_nsxv3.common.synchronization [req-e36e6f88-136b-44b7-b814-dd87c4630e7a req-c0d68e4c-3fd6-4589-b672-08fc54423a91 service nova] Enqueued Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGHEST for action security_group_rules [ 622.347950] env[65087]: INFO networking_nsxv3.common.synchronization [req-e36e6f88-136b-44b7-b814-dd87c4630e7a req-c0d68e4c-3fd6-4589-b672-08fc54423a91 service nova] Enqueued Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGHEST for action security_group_members [ 622.348166] env[65087]: INFO networking_nsxv3.common.synchronization [req-e36e6f88-136b-44b7-b814-dd87c4630e7a req-c0d68e4c-3fd6-4589-b672-08fc54423a91 service nova] Enqueued Resource ID: 437526b0-c107-41c3-85dc-d952f92d79b4 with Priority: HIGHEST for action port [ 622.349307] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGHEST for action security_group_rules [ 622.349404] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGHEST for action security_group_members [ 622.349509] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 437526b0-c107-41c3-85dc-d952f92d79b4 with Priority: HIGHEST for action port [ 622.351060] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9bb938-6d5d-4fc7-8385-f402075d6859 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.351316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.351416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.351744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.352065] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.353032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9bb938-6d5d-4fc7-8385-f402075d6859 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.353753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.353822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.354031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.354203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.354347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.354393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.354521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.354608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.354705] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.356538] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-437526b0-c107-41c3-85dc-d952f92d79b4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.356682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-437526b0-c107-41c3-85dc-d952f92d79b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.356800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-437526b0-c107-41c3-85dc-d952f92d79b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.356914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-437526b0-c107-41c3-85dc-d952f92d79b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.357226] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('437526b0-c107-41c3-85dc-d952f92d79b4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.386515] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.386897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.386897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.387040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.387134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.402037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56b74809-473d-4b46-a128-e8953c39feab in Status: IN_PROGRESS for 2s [ 622.736578] env[65087]: INFO networking_nsxv3.common.synchronization [None req-f7591e61-ed6e-4567-8ae6-b0193c6e925e None None] Enqueued Resource ID: 8be62df8-e92c-496f-9a3a-6c8a778ddafe with Priority: HIGHEST for action port [ 622.737150] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8be62df8-e92c-496f-9a3a-6c8a778ddafe with Priority: HIGHEST for action port [ 622.737458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8be62df8-e92c-496f-9a3a-6c8a778ddafe taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.737816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8be62df8-e92c-496f-9a3a-6c8a778ddafe" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.737816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8be62df8-e92c-496f-9a3a-6c8a778ddafe" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.739078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8be62df8-e92c-496f-9a3a-6c8a778ddafe" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.739338] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8be62df8-e92c-496f-9a3a-6c8a778ddafe',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.766234] env[65087]: INFO networking_nsxv3.common.synchronization [req-f8c608cc-6832-43b1-a04e-c8cc1ee45085 req-2cf67419-cff2-4b2c-a28a-8c72dd468999 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_members [ 622.766767] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_members [ 622.769366] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-75619e08-1842-4450-8de1-688a542e6f15 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.769475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.769538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.769828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.769995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.770248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.770334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.771215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.771215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.771215] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.803031] env[65087]: INFO networking_nsxv3.common.synchronization [None req-2901be11-0937-4fa3-b705-87e00709f35e None None] Enqueued Resource ID: 28a26180-aacf-4c48-bb1c-911eb3645d5a with Priority: HIGHEST for action port [ 622.803419] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a26180-aacf-4c48-bb1c-911eb3645d5a with Priority: HIGHEST for action port [ 622.803731] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-28a26180-aacf-4c48-bb1c-911eb3645d5a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.803859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28a26180-aacf-4c48-bb1c-911eb3645d5a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.803926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28a26180-aacf-4c48-bb1c-911eb3645d5a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.804224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28a26180-aacf-4c48-bb1c-911eb3645d5a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.804321] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28a26180-aacf-4c48-bb1c-911eb3645d5a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.857998] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.859424] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9bb938-6d5d-4fc7-8385-f402075d6859 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.860404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.860404] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 437526b0-c107-41c3-85dc-d952f92d79b4 with status ACTIVE [ 622.860404] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.860404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.860404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.860404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.860404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.860798] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.860798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.864077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.864620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.864620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.865348] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.865348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.865348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.865348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.865348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.865348] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 437526b0-c107-41c3-85dc-d952f92d79b4 is going to be updated. [ 622.887430] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.887688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.887688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.887800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.887944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.888327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-437526b0-c107-41c3-85dc-d952f92d79b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.932640] env[65087]: INFO networking_nsxv3.common.synchronization [None req-ab17a676-3b7a-43e7-8e93-c9e8d369388b tempest-ServersWithSpecificFlavorTestJSON-635744001 tempest-ServersWithSpecificFlavorTestJSON-635744001-project-member] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_rules [ 622.933966] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_rules [ 622.934374] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.934609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.934609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.934836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.934913] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.244301] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8be62df8-e92c-496f-9a3a-6c8a778ddafe [ 623.244301] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.244301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.244301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.244301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.244301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.244301] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8be62df8-e92c-496f-9a3a-6c8a778ddafe already deleted. [ 623.244301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8be62df8-e92c-496f-9a3a-6c8a778ddafe" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.274590] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.275316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.275733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.276034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.276202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.276524] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.276692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.277013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.277245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.278876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.278876] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75619e08-1842-4450-8de1-688a542e6f15 already deleted. [ 623.278876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.310427] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28a26180-aacf-4c48-bb1c-911eb3645d5a [ 623.310427] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.310427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.310427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.310427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.310427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.310427] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28a26180-aacf-4c48-bb1c-911eb3645d5a already deleted. [ 623.310427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28a26180-aacf-4c48-bb1c-911eb3645d5a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.315611] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.315863] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.316047] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.316422] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.316752] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.316927] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.317095] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.317381] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.317552] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.317829] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.317992] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.318153] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.318288] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.318430] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.318563] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.318721] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.339131] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.339317] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.339452] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.339815] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.339965] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-573f5134-af09-4eaf-909a-3bfffdb11dde taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.340282] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-573f5134-af09-4eaf-909a-3bfffdb11dde" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.340282] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-573f5134-af09-4eaf-909a-3bfffdb11dde" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.340530] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-573f5134-af09-4eaf-909a-3bfffdb11dde" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.340736] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('573f5134-af09-4eaf-909a-3bfffdb11dde',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.346223] env[65087]: INFO networking_nsxv3.common.synchronization [None req-db572238-2c83-405f-bae8-f4adf04ace33 tempest-ServersWithSpecificFlavorTestJSON-635744001 tempest-ServersWithSpecificFlavorTestJSON-635744001-project-member] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_rules [ 623.347117] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_rules [ 623.347219] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.347486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.369738] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.458879] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.459030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.459030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.459240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.459341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.459440] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 already deleted. [ 623.460050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.460050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.460050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.460050] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.844210] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.844574] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.844725] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.845017] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.845172] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.845345] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 573f5134-af09-4eaf-909a-3bfffdb11dde not found, creating... [ 623.845624] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.845778] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.845892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.846173] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.846382] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.846700] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.846877] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.847026] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.847277] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.847418] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.847580] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 573f5134-af09-4eaf-909a-3bfffdb11dde is going to be created. [ 623.867340] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.867552] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.867673] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.867934] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.868200] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.868497] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-573f5134-af09-4eaf-909a-3bfffdb11dde" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.872836] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.872998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.873069] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.873295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.873449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.873559] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9bb938-6d5d-4fc7-8385-f402075d6859 is going to be created. [ 623.902706] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.902848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.902919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.903150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.903320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.914135] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9bb938-6d5d-4fc7-8385-f402075d6859 in Status: UNINITIALIZED for 2s [ 623.996130] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.996130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.996130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.996619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.996619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.996619] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 already deleted. [ 623.996619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.420613] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 56b74809-473d-4b46-a128-e8953c39feab in Status: SUCCESS [ 624.420868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.730505] env[65087]: INFO networking_nsxv3.common.synchronization [req-f8c608cc-6832-43b1-a04e-c8cc1ee45085 req-5070cf39-bedf-4e4b-8877-cf44f82080e5 service nova] Enqueued Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_rules [ 624.730672] env[65087]: INFO networking_nsxv3.common.synchronization [req-f8c608cc-6832-43b1-a04e-c8cc1ee45085 req-5070cf39-bedf-4e4b-8877-cf44f82080e5 service nova] Enqueued Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_members [ 624.730803] env[65087]: INFO networking_nsxv3.common.synchronization [req-f8c608cc-6832-43b1-a04e-c8cc1ee45085 req-5070cf39-bedf-4e4b-8877-cf44f82080e5 service nova] Enqueued Resource ID: 573f5134-af09-4eaf-909a-3bfffdb11dde with Priority: HIGHEST for action port [ 624.731356] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_rules [ 624.731490] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_members [ 624.731581] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 573f5134-af09-4eaf-909a-3bfffdb11dde with Priority: HIGHEST for action port [ 624.731846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75619e08-1842-4450-8de1-688a542e6f15 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.732018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.732088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.732749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.732749] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.733225] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-75619e08-1842-4450-8de1-688a542e6f15 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.733334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.733402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.733567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.734213] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.734344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.734382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.734526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.734614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.734708] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.735522] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-573f5134-af09-4eaf-909a-3bfffdb11dde taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.735628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-573f5134-af09-4eaf-909a-3bfffdb11dde" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.735666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-573f5134-af09-4eaf-909a-3bfffdb11dde" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.735816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-573f5134-af09-4eaf-909a-3bfffdb11dde" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.735892] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('573f5134-af09-4eaf-909a-3bfffdb11dde',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.853522] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c48c657-7a5e-490b-8e39-6e37d75b9324 req-6209e420-333c-4d9e-a156-51479d75b864 tempest-VolumesAdminNegativeTest-828988360 tempest-VolumesAdminNegativeTest-828988360-project-member] Enqueued Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGHEST for action security_group_members [ 624.855492] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGHEST for action security_group_members [ 624.855846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.855983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.856095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.856365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.856573] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.856718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.856821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.857096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.857248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.857331] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.238437] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.241148] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-75619e08-1842-4450-8de1-688a542e6f15 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.241365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.242846] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 573f5134-af09-4eaf-909a-3bfffdb11dde with status ACTIVE [ 625.242846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.242846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.242846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.243372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.243459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.243706] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.244130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.244130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.244354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.244388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.244632] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.245186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.245186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.245384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.245384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.245471] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 573f5134-af09-4eaf-909a-3bfffdb11dde is going to be updated. [ 625.272562] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.273856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.273951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.274240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.274420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.274702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-573f5134-af09-4eaf-909a-3bfffdb11dde" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.358112] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.358324] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-620" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.358443] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-620" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.358765] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-620" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.359046] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.359204] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.359314] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.359559] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.359701] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.360083] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.360083] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.360179] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.360362] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.360362] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.360463] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.360529] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.362617] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.362835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.362949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.363089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.364608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.364608] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.364608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.364766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.365041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.365041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.365156] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd already deleted. [ 625.365211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.384113] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.384375] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.384557] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.384830] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-620" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.385379] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-557a0259-86eb-4a9a-ace3-41c9a8597b60 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.386076] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-557a0259-86eb-4a9a-ace3-41c9a8597b60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.386076] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-557a0259-86eb-4a9a-ace3-41c9a8597b60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.386627] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-557a0259-86eb-4a9a-ace3-41c9a8597b60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.386880] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('557a0259-86eb-4a9a-ace3-41c9a8597b60',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.748098] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.892531] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.892831] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.892995] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.893369] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.893548] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.893725] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 557a0259-86eb-4a9a-ace3-41c9a8597b60 not found, creating... [ 625.894032] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.894320] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.894320] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.894534] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.894669] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.894960] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.895156] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.895273] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.895482] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.895748] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.895814] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 557a0259-86eb-4a9a-ace3-41c9a8597b60 is going to be created. [ 625.923312] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.923765] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.923864] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.926602] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.926829] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.927510] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-557a0259-86eb-4a9a-ace3-41c9a8597b60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.928640] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9bb938-6d5d-4fc7-8385-f402075d6859 in Status: SUCCESS [ 625.928828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.930773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.930773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.930773] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.930773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.930773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.930773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.930773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.930773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.930773] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.053533] env[65087]: INFO networking_nsxv3.common.synchronization [None req-4e46e906-2af2-49a2-a424-33c1fd98453b None None] Enqueued Resource ID: f2f5a262-44fb-4a87-b528-413ced563772 with Priority: HIGHEST for action port [ 626.054371] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f5a262-44fb-4a87-b528-413ced563772 with Priority: HIGHEST for action port [ 626.054782] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f5a262-44fb-4a87-b528-413ced563772 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.054962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f5a262-44fb-4a87-b528-413ced563772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.055071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f5a262-44fb-4a87-b528-413ced563772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.055381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f5a262-44fb-4a87-b528-413ced563772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.055857] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f5a262-44fb-4a87-b528-413ced563772',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.252196] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.252196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.252196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.252196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.252196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.252708] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75619e08-1842-4450-8de1-688a542e6f15 is going to be created. [ 626.294601] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.294831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.294831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.295122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.296049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.312306] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75619e08-1842-4450-8de1-688a542e6f15 in Status: UNINITIALIZED for 2s [ 626.432956] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9bb938-6d5d-4fc7-8385-f402075d6859 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.433151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.433201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.433483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.433679] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.433793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.433871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.435461] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9bb938-6d5d-4fc7-8385-f402075d6859 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.435461] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.435461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.435461] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.560048] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2f5a262-44fb-4a87-b528-413ced563772 [ 626.560330] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.560478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.560546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.560759] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.560846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.560938] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2f5a262-44fb-4a87-b528-413ced563772 already deleted. [ 626.561019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f5a262-44fb-4a87-b528-413ced563772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.711675] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c48c657-7a5e-490b-8e39-6e37d75b9324 req-13a1487b-fd6b-4dd1-8ded-4fefbe3e9da6 service nova] Enqueued Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGHEST for action security_group_rules [ 626.711851] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c48c657-7a5e-490b-8e39-6e37d75b9324 req-13a1487b-fd6b-4dd1-8ded-4fefbe3e9da6 service nova] Enqueued Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGHEST for action security_group_members [ 626.712087] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c48c657-7a5e-490b-8e39-6e37d75b9324 req-13a1487b-fd6b-4dd1-8ded-4fefbe3e9da6 service nova] Enqueued Resource ID: 557a0259-86eb-4a9a-ace3-41c9a8597b60 with Priority: HIGHEST for action port [ 626.712863] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGHEST for action security_group_rules [ 626.713682] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGHEST for action security_group_members [ 626.713863] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 557a0259-86eb-4a9a-ace3-41c9a8597b60 with Priority: HIGHEST for action port [ 626.714184] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.714438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.714438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.714728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.714826] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.715705] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.716621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.716621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.716621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.716621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.716621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.716621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.716621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.716943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.716943] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.717670] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-557a0259-86eb-4a9a-ace3-41c9a8597b60 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.717741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-557a0259-86eb-4a9a-ace3-41c9a8597b60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.717780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-557a0259-86eb-4a9a-ace3-41c9a8597b60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.717926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-557a0259-86eb-4a9a-ace3-41c9a8597b60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.717996] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('557a0259-86eb-4a9a-ace3-41c9a8597b60',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.938913] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df9bb938-6d5d-4fc7-8385-f402075d6859: rpc.has_security_group_logging(os_id): False [ 626.961686] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.962206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.962365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.962701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.963203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.963276] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.963506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.963628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.963913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.964063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.964510] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.964651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.964740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.964932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.965022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.965239] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.965373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.965462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.965616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.965695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.965804] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9bb938-6d5d-4fc7-8385-f402075d6859 is going to be created. [ 627.047646] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.047950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.048070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.048480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.048819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.066848] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9bb938-6d5d-4fc7-8385-f402075d6859 in Status: IN_PROGRESS for 2s [ 627.220966] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.221181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.221483] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.224382] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 557a0259-86eb-4a9a-ace3-41c9a8597b60 with status ACTIVE [ 627.224382] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.224382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.224382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.224382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.224382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.224382] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.224382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.224382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.224382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.224382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.227846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.227846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.227846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.227846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.227846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.227846] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 557a0259-86eb-4a9a-ace3-41c9a8597b60 is going to be updated. [ 627.271300] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.271300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.271300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.271868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.271868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.271868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-557a0259-86eb-4a9a-ace3-41c9a8597b60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.729365] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.235499] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.235499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.235499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.235499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.235499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.235499] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd is going to be created. [ 628.264527] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.264817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.264954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.265319] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.265613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.282223] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd in Status: UNINITIALIZED for 2s [ 628.330599] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75619e08-1842-4450-8de1-688a542e6f15 in Status: SUCCESS [ 628.330599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.330599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.330599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.330599] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.330599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.330599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.330599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.330599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.330599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.330599] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.485174] env[65087]: INFO networking_nsxv3.common.synchronization [req-9cbd68b5-4cc2-4aad-82f1-1c2ca9b0e8fa req-bffe8bf9-3605-4e5b-8407-18f2e00dd85b tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 628.485174] env[65087]: INFO networking_nsxv3.common.synchronization [req-9cbd68b5-4cc2-4aad-82f1-1c2ca9b0e8fa req-bffe8bf9-3605-4e5b-8407-18f2e00dd85b tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 628.485174] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 628.485174] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 628.485174] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.485174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.485174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.485701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.485824] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.485913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.485984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.486180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.486274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.486363] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.487323] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.487435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.487505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.487663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.487840] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.487942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.489369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.489369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.489369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.489369] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.536679] env[65087]: INFO networking_nsxv3.common.synchronization [req-9cbd68b5-4cc2-4aad-82f1-1c2ca9b0e8fa req-bffe8bf9-3605-4e5b-8407-18f2e00dd85b tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_rules [ 628.537067] env[65087]: INFO networking_nsxv3.common.synchronization [req-9cbd68b5-4cc2-4aad-82f1-1c2ca9b0e8fa req-bffe8bf9-3605-4e5b-8407-18f2e00dd85b tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 628.537067] env[65087]: INFO networking_nsxv3.common.synchronization [req-9cbd68b5-4cc2-4aad-82f1-1c2ca9b0e8fa req-bffe8bf9-3605-4e5b-8407-18f2e00dd85b tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 628.537211] env[65087]: INFO networking_nsxv3.common.synchronization [req-9cbd68b5-4cc2-4aad-82f1-1c2ca9b0e8fa req-bffe8bf9-3605-4e5b-8407-18f2e00dd85b tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 628.537251] env[65087]: INFO networking_nsxv3.common.synchronization [req-9cbd68b5-4cc2-4aad-82f1-1c2ca9b0e8fa req-bffe8bf9-3605-4e5b-8407-18f2e00dd85b tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ef2ae025-7e74-42db-812c-dded1cafc1cf with Priority: HIGHEST for action port [ 628.538276] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_rules [ 628.538375] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 628.538421] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2ae025-7e74-42db-812c-dded1cafc1cf with Priority: HIGHEST for action port [ 628.538498] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 628.538588] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 628.538877] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.539015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.539085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.539383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.539470] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.541683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.541683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.541683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.542903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.542903] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.545623] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2ae025-7e74-42db-812c-dded1cafc1cf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.545623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.545623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.545623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.545623] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2ae025-7e74-42db-812c-dded1cafc1cf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.547018] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.547018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.547018] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.547018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.834027] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.990958] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.992032] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.010842] env[65087]: INFO networking_nsxv3.common.synchronization [req-3c95d699-44a9-4e4b-95d9-ceb2bf81b3b2 req-706ba5c5-5d2e-4507-979b-0b9b4cae5574 tempest-ServersTestFqdnHostnames-2087557967 tempest-ServersTestFqdnHostnames-2087557967-project-member] Enqueued Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_members [ 629.011315] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_members [ 629.012784] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e065c34d-9c70-483b-a4fb-2d44a853cbeb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.012784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.012784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.012784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.012784] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.012784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.012784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.013098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.013098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.013098] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.042610] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.042829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.045285] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.045285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.046340] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef2ae025-7e74-42db-812c-dded1cafc1cf with status ACTIVE [ 629.046558] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.046713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.046854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.047205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.047368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.047697] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.047839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.048866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.048866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.048866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.048866] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.048866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.048866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.048866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.049235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.049235] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef2ae025-7e74-42db-812c-dded1cafc1cf is going to be updated. [ 629.075067] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.075201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.075201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.075390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.075530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.075692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.080584] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df9bb938-6d5d-4fc7-8385-f402075d6859 in Status: SUCCESS [ 629.080584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.338399] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75619e08-1842-4450-8de1-688a542e6f15: rpc.has_security_group_logging(os_id): False [ 629.367264] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.367264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.367264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.367264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.367264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.367264] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.367264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.367264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.367264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.367264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.367264] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75619e08-1842-4450-8de1-688a542e6f15 is going to be created. [ 629.422183] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.422920] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-174" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.422920] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-174" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.423526] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-174" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.423827] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.424165] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.424165] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.424412] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.424770] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.424874] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.424982] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.425134] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.425290] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.425449] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.425578] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.425726] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.446409] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.446663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.446740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.446979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.447430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.450829] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.451072] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.451161] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.451281] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-174" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.451774] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-7166693b-be01-48e4-8be2-af6224ec1043 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.452118] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-7166693b-be01-48e4-8be2-af6224ec1043" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.453064] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-7166693b-be01-48e4-8be2-af6224ec1043" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.453345] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-7166693b-be01-48e4-8be2-af6224ec1043" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.453557] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7166693b-be01-48e4-8be2-af6224ec1043',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.462905] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75619e08-1842-4450-8de1-688a542e6f15 in Status: IN_PROGRESS for 2s [ 629.493996] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.494976] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.514804] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.515038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.515038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.515299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.515397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.515964] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.516135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.516205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.516402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.516490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.516592] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb already deleted. [ 629.516922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.956983] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.957273] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.957514] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.957711] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.957888] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.958364] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 7166693b-be01-48e4-8be2-af6224ec1043 not found, creating... [ 629.958849] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.958982] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.959118] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.959411] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.959555] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.960119] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.960251] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.960487] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.960720] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.960808] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.960952] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 7166693b-be01-48e4-8be2-af6224ec1043 is going to be created. [ 629.986490] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.986490] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.986490] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.986490] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.986490] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.987662] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-7166693b-be01-48e4-8be2-af6224ec1043" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.999076] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.999076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.999076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.999583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.999583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.999583] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 630.003514] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.003514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.003514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.003514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.003514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.003514] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc is going to be created. [ 630.063081] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.063081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.063669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.063669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.063768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.083224] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: UNINITIALIZED for 2s [ 630.086434] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.086852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.086852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.087113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.087351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.111542] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 630.303411] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd in Status: SUCCESS [ 630.303648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.304778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.304778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.304778] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.304778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.304778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.304778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.304778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.305211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.305211] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.700039] env[65087]: INFO networking_nsxv3.common.synchronization [req-3c95d699-44a9-4e4b-95d9-ceb2bf81b3b2 req-d085eb6b-38c6-44e1-8425-9eff02a934d7 service nova] Enqueued Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_rules [ 630.700039] env[65087]: INFO networking_nsxv3.common.synchronization [req-3c95d699-44a9-4e4b-95d9-ceb2bf81b3b2 req-d085eb6b-38c6-44e1-8425-9eff02a934d7 service nova] Enqueued Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_members [ 630.700039] env[65087]: INFO networking_nsxv3.common.synchronization [req-3c95d699-44a9-4e4b-95d9-ceb2bf81b3b2 req-d085eb6b-38c6-44e1-8425-9eff02a934d7 service nova] Enqueued Resource ID: 7166693b-be01-48e4-8be2-af6224ec1043 with Priority: HIGHEST for action port [ 630.701224] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_rules [ 630.701778] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_members [ 630.701778] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7166693b-be01-48e4-8be2-af6224ec1043 with Priority: HIGHEST for action port [ 630.705132] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.705132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.705132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.705132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.705132] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.709079] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e065c34d-9c70-483b-a4fb-2d44a853cbeb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.709079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.709079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.710603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.710603] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.710603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.711461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.711461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.711461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.711461] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.712591] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7166693b-be01-48e4-8be2-af6224ec1043 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.713218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7166693b-be01-48e4-8be2-af6224ec1043" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.713218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7166693b-be01-48e4-8be2-af6224ec1043" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.713218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7166693b-be01-48e4-8be2-af6224ec1043" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.713928] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7166693b-be01-48e4-8be2-af6224ec1043',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.807154] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.807382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.807382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.807961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.807961] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.808565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.808565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.808565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.808731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.808766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.808920] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.809026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.809081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.809264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.809424] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.809520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.809594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.809801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.809801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.809941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.809998] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.221023] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.221023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e065c34d-9c70-483b-a4fb-2d44a853cbeb taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.221023] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7166693b-be01-48e4-8be2-af6224ec1043 with status ACTIVE [ 631.221023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.221023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.221023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.221775] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.221775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.223043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.223314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.223428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.223528] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7166693b-be01-48e4-8be2-af6224ec1043 is going to be updated. [ 631.255257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.255257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.255257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.255439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.255478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.255680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7166693b-be01-48e4-8be2-af6224ec1043" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.312780] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14277918-93e7-4b1d-8bdd-a2eb46c04cdd: rpc.has_security_group_logging(os_id): False [ 631.341877] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.342241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.342241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.342751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.342751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.342950] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.343121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.343198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.343448] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.343557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.343833] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.343941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.344017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.344322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.344322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.345091] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.345091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.345091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.345091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.345091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.345091] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd is going to be created. [ 631.468691] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.468691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.468691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.468691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.468691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.480040] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75619e08-1842-4450-8de1-688a542e6f15 in Status: SUCCESS [ 631.480040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.480649] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd in Status: IN_PROGRESS for 2s [ 631.714640] env[65087]: INFO networking_nsxv3.common.synchronization [req-f74d62db-d51a-406b-8a4c-94598feebbd4 req-5d2d649e-5bec-40b9-9e63-eb7c56fe07b5 tempest-TenantUsagesTestJSON-201675620 tempest-TenantUsagesTestJSON-201675620-project-member] Enqueued Resource ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 with Priority: HIGHEST for action security_group_members [ 631.716557] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 with Priority: HIGHEST for action security_group_members [ 631.717112] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-de120ad0-cbd8-47c5-85f0-73d798da60f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.717250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.717321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.717936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.718715] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.718912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.718992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.719201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.720209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.720404] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de120ad0-cbd8-47c5-85f0-73d798da60f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.726625] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.096942] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: SUCCESS [ 632.096942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.096942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.097185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.097402] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.097653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.097653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.097837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.097965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.098040] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.126051] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 632.126336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.126521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.126923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.127073] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.127189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.127189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.127315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.127443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.127555] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.230568] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.230781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.230858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.231097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.231196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.231661] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.231775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.231840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.232013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.232239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.232332] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 already deleted. [ 632.232417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.232730] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.232827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.232884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.233040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.233139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.234599] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb is going to be created. [ 632.274911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.274911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.274911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.274911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.274911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.291053] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb in Status: UNINITIALIZED for 2s [ 632.482855] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.483110] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.483220] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.483585] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.484768] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.484946] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.487892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.487892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.487892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.487892] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.487892] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.487892] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.487892] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.487892] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.487892] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.487892] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.506343] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.506761] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.506913] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.507107] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.507559] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.507739] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.507857] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.508236] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.508353] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2960907f-ddaa-45fb-a7e1-8f4372fa1a2f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.602846] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.631401] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.011778] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.013238] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.013238] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.014270] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.014753] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.014907] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 2960907f-ddaa-45fb-a7e1-8f4372fa1a2f not found, creating... [ 633.015341] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.016444] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.016444] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.016894] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.017102] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.018023] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.018023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.018023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.018261] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.018314] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.018808] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 2960907f-ddaa-45fb-a7e1-8f4372fa1a2f is going to be created. [ 633.049152] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.049429] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.049429] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.049780] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.049913] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.050325] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.105456] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.134815] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.498450] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd in Status: SUCCESS [ 633.498732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.610932] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.610932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.610932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.610932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.610932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.610932] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc is going to be updated. [ 633.642037] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.642037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.642037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.642037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.642037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.642037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 633.642037] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.642037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.642037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.642823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.643178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.655116] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: IN_PROGRESS for 2s [ 633.681309] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.681309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.681309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.681613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.681658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.695611] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 633.831553] env[65087]: INFO networking_nsxv3.common.synchronization [req-f74d62db-d51a-406b-8a4c-94598feebbd4 req-a0913a10-849a-4e48-bfb6-906a48d76606 service nova] Enqueued Resource ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 with Priority: HIGHEST for action security_group_rules [ 633.831553] env[65087]: INFO networking_nsxv3.common.synchronization [req-f74d62db-d51a-406b-8a4c-94598feebbd4 req-a0913a10-849a-4e48-bfb6-906a48d76606 service nova] Enqueued Resource ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 with Priority: HIGHEST for action security_group_members [ 633.831553] env[65087]: INFO networking_nsxv3.common.synchronization [req-f74d62db-d51a-406b-8a4c-94598feebbd4 req-a0913a10-849a-4e48-bfb6-906a48d76606 service nova] Enqueued Resource ID: 2960907f-ddaa-45fb-a7e1-8f4372fa1a2f with Priority: HIGHEST for action port [ 633.831553] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 with Priority: HIGHEST for action security_group_rules [ 633.831553] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 with Priority: HIGHEST for action security_group_members [ 633.831553] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2960907f-ddaa-45fb-a7e1-8f4372fa1a2f with Priority: HIGHEST for action port [ 633.831553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de120ad0-cbd8-47c5-85f0-73d798da60f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.831553] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de120ad0-cbd8-47c5-85f0-73d798da60f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.831553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-de120ad0-cbd8-47c5-85f0-73d798da60f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.831553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.831553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.832476] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de120ad0-cbd8-47c5-85f0-73d798da60f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.834735] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.835183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.835273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.835493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.835640] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2960907f-ddaa-45fb-a7e1-8f4372fa1a2f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.085817] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 634.086166] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 634.087137] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 with Priority: HIGHEST for action security_group_members [ 634.087137] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 634.087137] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 634.087854] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 with Priority: HIGHEST for action security_group_members [ 634.087854] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.087854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.087854] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.088016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.088155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-851d68f8-1229-406c-ac33-c91b60c34ee0 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.088155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.088373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.088515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.092139] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.092139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.092139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.092139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.092139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.092139] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.144890] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 with Priority: HIGHEST for action security_group_rules [ 634.145092] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 with Priority: HIGHEST for action security_group_members [ 634.145229] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_rules [ 634.145350] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 634.145467] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 634.145583] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 634.145709] env[65087]: INFO networking_nsxv3.common.synchronization [req-362439de-4184-4b8a-9ddb-9cbb5aadf56d req-396dcdcf-5e9e-4c87-b649-75c0401e5477 tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ef2ae025-7e74-42db-812c-dded1cafc1cf with Priority: HIGHEST for action port [ 634.146322] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 with Priority: HIGHEST for action security_group_rules [ 634.146458] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_rules [ 634.146555] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 634.146646] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2ae025-7e74-42db-812c-dded1cafc1cf with Priority: HIGHEST for action port [ 634.146733] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 634.146817] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 with Priority: HIGHEST for action security_group_members [ 634.146900] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 634.147205] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-851d68f8-1229-406c-ac33-c91b60c34ee0 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.147288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.147354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.147619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.147694] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.148549] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.148650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.149707] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.149707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.149707] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2ae025-7e74-42db-812c-dded1cafc1cf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.149998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.149998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.149998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.150132] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2ae025-7e74-42db-812c-dded1cafc1cf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.150911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.150992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.151170] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-851d68f8-1229-406c-ac33-c91b60c34ee0 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.151251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.151696] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.151696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.306247] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb in Status: SUCCESS [ 634.306477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.306646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.306870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.307197] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.307197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.307346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.309295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.309295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.309295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.309295] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.342037] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-de120ad0-cbd8-47c5-85f0-73d798da60f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.342037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.342037] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de120ad0-cbd8-47c5-85f0-73d798da60f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.342037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2960907f-ddaa-45fb-a7e1-8f4372fa1a2f with status ACTIVE [ 634.342037] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.342037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.342037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.342037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.342037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.342037] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.342958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.342958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.342958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.342958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.342958] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.342958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.342958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.342958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.342958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.344940] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2960907f-ddaa-45fb-a7e1-8f4372fa1a2f is going to be updated. [ 634.369850] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.369850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.369850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.369850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.369850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.369850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2960907f-ddaa-45fb-a7e1-8f4372fa1a2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.591968] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.652901] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-851d68f8-1229-406c-ac33-c91b60c34ee0 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.653140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.653355] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef2ae025-7e74-42db-812c-dded1cafc1cf with status ACTIVE [ 634.653551] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.653699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.653769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.654008] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.654147] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.654327] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.654439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.654509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.654707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.654801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.655012] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.655148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.655222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.655379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.655488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.655600] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef2ae025-7e74-42db-812c-dded1cafc1cf is going to be updated. [ 634.678803] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.679047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.679150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.679374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.679545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.679719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2ae025-7e74-42db-812c-dded1cafc1cf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.811965] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.844975] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de120ad0-cbd8-47c5-85f0-73d798da60f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.094482] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.315675] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e065c34d-9c70-483b-a4fb-2d44a853cbeb: rpc.has_security_group_logging(os_id): False [ 635.335466] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.335676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.335724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.335968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.336066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.336375] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.336482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.336547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.336712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.336792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.336881] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb is going to be created. [ 635.347276] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.347519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.347519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.347736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.347816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.347947] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 is going to be created. [ 635.375798] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.375967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.376034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.376408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.376408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.386560] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 in Status: UNINITIALIZED for 2s [ 635.406032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.406192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.406256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.406470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.406669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.423167] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb in Status: IN_PROGRESS for 2s [ 635.597334] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.597569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.597569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.597791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.598444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.598444] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 is going to be created. [ 635.643682] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.643894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.643894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.644706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.644706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.665760] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 in Status: UNINITIALIZED for 2s [ 635.670919] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: SUCCESS [ 635.671077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.671152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.671934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.671934] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.671934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.671934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.671934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.671934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.672455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.672455] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.676406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.676842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.676842] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.677076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.677076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.677220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.677220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.677326] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.710095] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 635.710095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.710095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.710558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.712555] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.712555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.712555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.712555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.712555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.712555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.712555] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.714198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.714513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.716048] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.716048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.716048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.716048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.716048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.716048] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.180836] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.181571] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.217340] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.218400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.218400] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.329492] env[65087]: INFO networking_nsxv3.common.synchronization [None req-15d71df7-370f-4cf6-9919-de14e1de6f32 None None] Enqueued Resource ID: 2829766c-6051-4c7c-902b-1dd19465bf1c with Priority: HIGHEST for action port [ 636.330159] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2829766c-6051-4c7c-902b-1dd19465bf1c with Priority: HIGHEST for action port [ 636.330651] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2829766c-6051-4c7c-902b-1dd19465bf1c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.330866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2829766c-6051-4c7c-902b-1dd19465bf1c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.330984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2829766c-6051-4c7c-902b-1dd19465bf1c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.331323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2829766c-6051-4c7c-902b-1dd19465bf1c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.331496] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2829766c-6051-4c7c-902b-1dd19465bf1c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.684276] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8adf627f-6f53-4e8f-bb06-db2aedef22fc: rpc.has_security_group_logging(os_id): False [ 636.685913] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.711479] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.711620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.711676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.711910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.712059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.712357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.712449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.712512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.712696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.712786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.712877] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc is going to be created. [ 636.721703] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.783532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.783813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.783813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.784147] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.784346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.800033] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: IN_PROGRESS for 2s [ 636.834796] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2829766c-6051-4c7c-902b-1dd19465bf1c [ 636.835049] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.835205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.835300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.835527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.835621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.835730] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2829766c-6051-4c7c-902b-1dd19465bf1c already deleted. [ 636.835795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2829766c-6051-4c7c-902b-1dd19465bf1c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.190693] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.191063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.191063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.191157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.191261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.191355] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc is going to be updated. [ 637.224650] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.224650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.224650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.224650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.224650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.224650] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 637.229568] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.230397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.230397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.230397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.230397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.239553] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: IN_PROGRESS for 2s [ 637.281848] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.282070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.282243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.282963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.282963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.298194] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 637.400243] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 in Status: SUCCESS [ 637.401570] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.402198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.402198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.404722] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.404722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.404722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.404722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.404722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.404722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.404722] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de120ad0-cbd8-47c5-85f0-73d798da60f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.438066] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb in Status: SUCCESS [ 637.438311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.679540] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 in Status: SUCCESS [ 637.679748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.681293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.681293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.681502] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.681620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.681620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.681768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.681852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.682283] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.907553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-de120ad0-cbd8-47c5-85f0-73d798da60f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.907553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.907839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.907839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.907976] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.908151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.908151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.908313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.908402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.908490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.908681] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-de120ad0-cbd8-47c5-85f0-73d798da60f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.908753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.908794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.908923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.909077] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.909174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.909237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.909379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.909457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.909536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.909625] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de120ad0-cbd8-47c5-85f0-73d798da60f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.187281] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.413432] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de120ad0-cbd8-47c5-85f0-73d798da60f8: rpc.has_security_group_logging(os_id): False [ 638.435883] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.436113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.436232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.436403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.436511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.436729] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.436841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.436915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.437103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.437195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.437446] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.437561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.437631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.437864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.438039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.438708] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.438827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.438885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.439661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.439782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.439882] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 is going to be created. [ 638.521420] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.521740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.521740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.521856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.522078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.538839] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 in Status: IN_PROGRESS for 2s [ 638.689603] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.815846] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: SUCCESS [ 638.815846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.815846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.815846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.815846] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.193989] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.194166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.194239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.194495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.194611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.194716] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 is going to be updated. [ 639.235438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.235438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.235438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.235438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.235438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.253412] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 in Status: IN_PROGRESS for 2s [ 639.254646] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: SUCCESS [ 639.254914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.255399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.255746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.257085] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.257085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.257085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.257085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.257495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.257495] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.318079] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.318343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.320330] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 639.320608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.321328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.321328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.321328] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.321563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.321563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.321835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.321835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.321939] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.506073] env[65087]: INFO networking_nsxv3.common.synchronization [req-4b7e2147-d3ea-4fdd-8f7c-3b3c77cec7b9 req-62bd0b55-b29e-476d-9153-dc1a8674d3de tempest-MigrationsAdminTest-836415837 tempest-MigrationsAdminTest-836415837-project-member] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 639.506589] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 639.507078] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.507211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.507280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.507860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.507939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.508122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.508615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.508761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.508852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.508948] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.759958] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.805506] env[65087]: INFO networking_nsxv3.common.synchronization [None req-b4afbf65-897f-46f0-8446-991c59ce28a8 None None] Enqueued Resource ID: 04463f02-9e54-48c0-91a0-e8a4bc2bddac with Priority: HIGHEST for action port [ 639.806099] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04463f02-9e54-48c0-91a0-e8a4bc2bddac with Priority: HIGHEST for action port [ 639.806369] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-04463f02-9e54-48c0-91a0-e8a4bc2bddac taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.806516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04463f02-9e54-48c0-91a0-e8a4bc2bddac" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.806578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04463f02-9e54-48c0-91a0-e8a4bc2bddac" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.806944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04463f02-9e54-48c0-91a0-e8a4bc2bddac" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.806944] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04463f02-9e54-48c0-91a0-e8a4bc2bddac',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.825601] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.865449] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.865660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.865791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.866097] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.866500] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.866671] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.866794] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.867035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.867194] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.867391] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.867514] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.867647] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.867765] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.867894] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.868049] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.868232] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.891074] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.891270] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.891401] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.891572] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.891891] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.892091] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.892248] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.892584] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.892732] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb5a534-d93f-42c2-a09b-7a0cfc7a0240',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.012790] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.012937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.012937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.013541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.013541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.013541] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.014098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.014098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.014098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.014098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.014098] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 already deleted. [ 640.014098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.135104] env[65087]: INFO networking_nsxv3.common.synchronization [None req-bef27cd3-a35c-4687-8657-0c824b50a07e None None] Enqueued Resource ID: 30ac5b4d-b52d-4839-880b-e59d18abcedc with Priority: HIGHEST for action port [ 640.135104] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30ac5b4d-b52d-4839-880b-e59d18abcedc with Priority: HIGHEST for action port [ 640.135499] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-30ac5b4d-b52d-4839-880b-e59d18abcedc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.135797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30ac5b4d-b52d-4839-880b-e59d18abcedc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.135991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30ac5b4d-b52d-4839-880b-e59d18abcedc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.136346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30ac5b4d-b52d-4839-880b-e59d18abcedc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.136550] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30ac5b4d-b52d-4839-880b-e59d18abcedc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.262037] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.311052] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04463f02-9e54-48c0-91a0-e8a4bc2bddac [ 640.311401] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.311658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.311743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.312126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.312126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.312345] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04463f02-9e54-48c0-91a0-e8a4bc2bddac already deleted. [ 640.312345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04463f02-9e54-48c0-91a0-e8a4bc2bddac" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.329187] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.395216] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.395453] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.395538] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.395814] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.395958] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.396118] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port bcb5a534-d93f-42c2-a09b-7a0cfc7a0240 not found, creating... [ 640.396369] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.396521] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.396642] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.396857] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.397061] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.397383] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.397559] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.397697] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.397907] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.398086] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.398234] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: bcb5a534-d93f-42c2-a09b-7a0cfc7a0240 is going to be created. [ 640.419267] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.419495] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.419578] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.419854] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.420095] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.420407] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.557336] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 in Status: SUCCESS [ 640.557625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.641311] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30ac5b4d-b52d-4839-880b-e59d18abcedc [ 640.641311] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.641550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.641550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.641703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.641842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.641983] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30ac5b4d-b52d-4839-880b-e59d18abcedc already deleted. [ 640.642353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30ac5b4d-b52d-4839-880b-e59d18abcedc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.765727] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.765727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.765727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.765995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.765995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.766921] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc is going to be updated. [ 640.804132] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.804132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.804132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.804132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.804132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.818904] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: IN_PROGRESS for 2s [ 640.836082] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.836082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.836082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.836082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.836082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.836082] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 640.867461] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.867731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.867847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.868258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.868488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.881795] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 641.231715] env[65087]: INFO networking_nsxv3.common.synchronization [req-4b7e2147-d3ea-4fdd-8f7c-3b3c77cec7b9 req-37d31e20-c708-436e-914b-f869425d77ee service nova] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_rules [ 641.231930] env[65087]: INFO networking_nsxv3.common.synchronization [req-4b7e2147-d3ea-4fdd-8f7c-3b3c77cec7b9 req-37d31e20-c708-436e-914b-f869425d77ee service nova] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 641.232072] env[65087]: INFO networking_nsxv3.common.synchronization [req-4b7e2147-d3ea-4fdd-8f7c-3b3c77cec7b9 req-37d31e20-c708-436e-914b-f869425d77ee service nova] Enqueued Resource ID: bcb5a534-d93f-42c2-a09b-7a0cfc7a0240 with Priority: HIGHEST for action port [ 641.232756] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_rules [ 641.232952] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 641.232988] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb5a534-d93f-42c2-a09b-7a0cfc7a0240 with Priority: HIGHEST for action port [ 641.233376] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.233541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.233577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.233863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.233984] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.237478] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.237621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.237688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.237900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.238142] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.238296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.238371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.238549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.238693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.242692] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.243963] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.245314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.245408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.245638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.245721] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb5a534-d93f-42c2-a09b-7a0cfc7a0240',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.266625] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 in Status: SUCCESS [ 641.266899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.268133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.268133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.268133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.268133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.268133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.268863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.268863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.268863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.268863] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.648761] env[65087]: INFO networking_nsxv3.common.synchronization [req-97de274e-0fa8-49c6-bfb5-f4a5376259a6 req-fae445bd-2c18-4077-bc32-603d532f7a55 tempest-ServersAdminNegativeTestJSON-2073613632 tempest-ServersAdminNegativeTestJSON-2073613632-project-member] Enqueued Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 641.649424] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 641.649986] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.650327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.650399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.650603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.650768] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.650872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.650931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.654373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.654514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.654665] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.748163] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.748887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.750782] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcb5a534-d93f-42c2-a09b-7a0cfc7a0240 with status ACTIVE [ 641.750970] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.751092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.752110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.752110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.752110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.752110] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.752110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.752110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.752110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.752110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.752827] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.752957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.753407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.753407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.753407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.753536] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcb5a534-d93f-42c2-a09b-7a0cfc7a0240 is going to be updated. [ 641.755348] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.773428] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.782531] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.782531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.782531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.782531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.782531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.782531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb5a534-d93f-42c2-a09b-7a0cfc7a0240" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.799919] env[65087]: INFO networking_nsxv3.common.synchronization [None req-81242916-37da-45bb-a6fe-05511f3d8c0c tempest-ServersTestJSON-1091804776 tempest-ServersTestJSON-1091804776-project-member] Enqueued Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_rules [ 641.802213] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_rules [ 641.802213] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.802213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.802213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.802213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.802213] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.024023] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.024336] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.024991] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.024991] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.025305] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.025305] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.025493] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.025815] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.025984] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.028122] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.028122] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.028122] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.028122] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.028122] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.028122] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.028122] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.052054] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.052348] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.052592] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.052801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.054545] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-ecaf3570-36bd-41c5-804f-416efe709f8b taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.054545] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-ecaf3570-36bd-41c5-804f-416efe709f8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.054545] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-ecaf3570-36bd-41c5-804f-416efe709f8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.054545] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-ecaf3570-36bd-41c5-804f-416efe709f8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.054545] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecaf3570-36bd-41c5-804f-416efe709f8b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.157398] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.258771] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.274861] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 851d68f8-1229-406c-ac33-c91b60c34ee0: rpc.has_security_group_logging(os_id): False [ 642.299352] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.299352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.299352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.299669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.299706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.299923] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.300042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.300119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.300413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.300413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.300574] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 is going to be created. [ 642.326944] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.327219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.327219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.327395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.327475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.327573] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 already deleted. [ 642.327666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.354701] env[65087]: INFO networking_nsxv3.common.synchronization [None req-11c33c0d-864b-4cd7-a051-cf27894fb7bc tempest-ServersTestJSON-1091804776 tempest-ServersTestJSON-1091804776-project-member] Enqueued Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_rules [ 642.355414] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_rules [ 642.355674] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.355836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.355946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.356296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.356406] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.392086] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.392374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.392533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.392888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.393222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.408915] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 in Status: IN_PROGRESS for 2s [ 642.556977] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.557236] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.557302] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.557639] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.557789] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.557938] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port ecaf3570-36bd-41c5-804f-416efe709f8b not found, creating... [ 642.560012] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.560258] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.560345] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.560584] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.560730] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.561035] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.561190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.561300] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.561576] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.561768] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.561923] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: ecaf3570-36bd-41c5-804f-416efe709f8b is going to be created. [ 642.588126] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.588445] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.588600] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.588884] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.589128] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.589420] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-ecaf3570-36bd-41c5-804f-416efe709f8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.660063] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.760037] env[65087]: INFO networking_nsxv3.common.synchronization [None req-7f25ea45-5ff1-4d26-a7cb-5dace15a698b None None] Enqueued Resource ID: a8986961-4b7f-4e54-9fb5-7db60f49cea4 with Priority: HIGHEST for action port [ 642.760690] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8986961-4b7f-4e54-9fb5-7db60f49cea4 with Priority: HIGHEST for action port [ 642.761043] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8986961-4b7f-4e54-9fb5-7db60f49cea4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.761206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8986961-4b7f-4e54-9fb5-7db60f49cea4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.761271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8986961-4b7f-4e54-9fb5-7db60f49cea4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.761545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8986961-4b7f-4e54-9fb5-7db60f49cea4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.762877] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8986961-4b7f-4e54-9fb5-7db60f49cea4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.764621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.764776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.764856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.765106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.765220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.765335] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be created. [ 642.797441] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.797738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.797792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.798177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.798295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.815614] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: UNINITIALIZED for 2s [ 642.828730] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: SUCCESS [ 642.828956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.829443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.829675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.829885] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.830017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.830182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.830449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.830449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.830560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.830623] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.881645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.881908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.881908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.882141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.882307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.882408] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 already deleted. [ 642.882496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.891586] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 642.892255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.892255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.892255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.892513] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.892572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.892635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.892781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.892902] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.892940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.893107] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.893260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.893260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.893420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.893562] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.893652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.893704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.893829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.893904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.893983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.894084] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.162868] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.163011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.163011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.163286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.163365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.163834] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c is going to be updated. [ 643.202012] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.202504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.202504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.202621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.203197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.216741] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: IN_PROGRESS for 2s [ 643.265147] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8986961-4b7f-4e54-9fb5-7db60f49cea4 [ 643.265965] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.267320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.267320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.267320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.267320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.267320] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8986961-4b7f-4e54-9fb5-7db60f49cea4 already deleted. [ 643.267320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8986961-4b7f-4e54-9fb5-7db60f49cea4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.332659] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.363091] env[65087]: INFO networking_nsxv3.common.synchronization [req-97de274e-0fa8-49c6-bfb5-f4a5376259a6 req-f9d99f3f-a80d-47c4-96fa-0865d50814ae service nova] Enqueued Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_rules [ 643.363372] env[65087]: INFO networking_nsxv3.common.synchronization [req-97de274e-0fa8-49c6-bfb5-f4a5376259a6 req-f9d99f3f-a80d-47c4-96fa-0865d50814ae service nova] Enqueued Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 643.363616] env[65087]: INFO networking_nsxv3.common.synchronization [req-97de274e-0fa8-49c6-bfb5-f4a5376259a6 req-f9d99f3f-a80d-47c4-96fa-0865d50814ae service nova] Enqueued Resource ID: ecaf3570-36bd-41c5-804f-416efe709f8b with Priority: HIGHEST for action port [ 643.365360] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_rules [ 643.365360] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 643.365360] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecaf3570-36bd-41c5-804f-416efe709f8b with Priority: HIGHEST for action port [ 643.365360] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.365360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.365360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.365639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.365639] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.367358] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.367452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.369184] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecaf3570-36bd-41c5-804f-416efe709f8b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.369184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecaf3570-36bd-41c5-804f-416efe709f8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.369184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecaf3570-36bd-41c5-804f-416efe709f8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.369184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecaf3570-36bd-41c5-804f-416efe709f8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.369184] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecaf3570-36bd-41c5-804f-416efe709f8b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.396177] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3c0a5a-197c-4c4c-a82b-9342302fe922: rpc.has_security_group_logging(os_id): False [ 643.424773] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.424985] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.425076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.425472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.425472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.425610] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.426113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.426113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.426113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.426113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.426739] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.426739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.426739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.426935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.426935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.427580] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.427698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.427767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.427943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.428038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.428131] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 643.510029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.510029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.510029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.510029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.510029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.522315] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 643.835503] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8adf627f-6f53-4e8f-bb06-db2aedef22fc: rpc.has_security_group_logging(os_id): False [ 643.854983] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.854983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.854983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.855331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.856074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.856074] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.856074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.856074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.856074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.856398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.856398] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc is going to be updated. [ 643.870318] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.870677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.874437] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecaf3570-36bd-41c5-804f-416efe709f8b with status ACTIVE [ 643.874437] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.874437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.874437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.874437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.874437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.874437] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.874437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.874437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.874437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.875060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.875060] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.875060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.875060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.875060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.875297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.875297] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecaf3570-36bd-41c5-804f-416efe709f8b is going to be updated. [ 643.896846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.896846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.897158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.897158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.897674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.897674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecaf3570-36bd-41c5-804f-416efe709f8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.928896] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.929081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.929134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.929338] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.929483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.949769] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: IN_PROGRESS for 2s [ 644.424065] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 in Status: SUCCESS [ 644.424600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.523654] env[65087]: INFO networking_nsxv3.common.synchronization [req-c667f72d-54dc-4891-a0d4-a7e5203b3284 req-c8bdc471-28d3-4bf8-9eba-d52e3e943e0f tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 644.524164] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 644.524538] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.524672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.524672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.524980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.525299] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.525414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.527944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.527944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.527944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.527944] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.826743] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: SUCCESS [ 644.826991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.829044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.829044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.829044] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.829044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.829044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.829044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.829044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.829044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.829044] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.028162] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.028162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.028162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.028688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.028688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.028770] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.028827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.029495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.029495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.029495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.029495] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 already deleted. [ 645.029495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.046036] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-150 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.046036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-150" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.046036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-150" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.046036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-150" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.046036] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.046036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.046036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.046036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.046614] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.047022] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.047278] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.047545] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.047773] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.047998] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.048209] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.048488] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.071215] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.073022] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.073022] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.073022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-150" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.073022] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-226d90d4-6acd-461c-91eb-55fea113ddaf taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.073022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.073022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.073626] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.073890] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226d90d4-6acd-461c-91eb-55fea113ddaf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.231347] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: SUCCESS [ 645.231682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.231923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.232186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.232421] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.232572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.232643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.232805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.232888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.233014] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.332287] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.332498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.332579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.332795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.333064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.333161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.333161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.333343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.333434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.333529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.333707] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.333794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.333847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.333997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.334194] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.334281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.334340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.334486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.334594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.334633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.334758] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.536393] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 645.536637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.536839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.537065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.537160] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.577380] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.577622] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.577919] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.578036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.578211] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.578384] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 226d90d4-6acd-461c-91eb-55fea113ddaf not found, creating... [ 645.578619] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.578771] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.578883] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.579113] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.579355] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.579518] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.579667] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.579776] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.579974] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.580692] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.580878] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 226d90d4-6acd-461c-91eb-55fea113ddaf is going to be created. [ 645.606109] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.606340] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.606466] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.607889] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.608355] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.608617] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.736974] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.838888] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d32cda0b-8a2f-42b1-8b70-9028c276b777: rpc.has_security_group_logging(os_id): False [ 645.858374] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.858555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.858595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.858888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.859010] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.859237] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.859347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.859454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.859787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.859863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.860354] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.860354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.860354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.860527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.860561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.860785] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.860883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.860944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.861106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.861173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.861257] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be created. [ 645.940397] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.940397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.940397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.940397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.940397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.953066] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: IN_PROGRESS for 2s [ 645.966175] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: SUCCESS [ 645.968832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.044407] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.044407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.044407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.044407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.044407] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.044407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.044407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.044407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.044407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.044407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.044407] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.240991] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.469757] env[65087]: INFO networking_nsxv3.common.synchronization [req-c667f72d-54dc-4891-a0d4-a7e5203b3284 req-953453f8-3bcc-40b8-a53c-575b113cde84 service nova] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 646.469950] env[65087]: INFO networking_nsxv3.common.synchronization [req-c667f72d-54dc-4891-a0d4-a7e5203b3284 req-953453f8-3bcc-40b8-a53c-575b113cde84 service nova] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 646.470108] env[65087]: INFO networking_nsxv3.common.synchronization [req-c667f72d-54dc-4891-a0d4-a7e5203b3284 req-953453f8-3bcc-40b8-a53c-575b113cde84 service nova] Enqueued Resource ID: 226d90d4-6acd-461c-91eb-55fea113ddaf with Priority: HIGHEST for action port [ 646.470720] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 646.470884] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 646.470987] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 226d90d4-6acd-461c-91eb-55fea113ddaf with Priority: HIGHEST for action port [ 646.473294] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.474300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.474402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.474658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.474747] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.475756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.475885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.475947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.476165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.476323] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.476518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.476518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.476692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.476782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.476879] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.477749] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-226d90d4-6acd-461c-91eb-55fea113ddaf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.478672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.478672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.478672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.478672] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226d90d4-6acd-461c-91eb-55fea113ddaf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.547975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.548423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.548621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.548965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.549269] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.550618] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.550618] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.550618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.551100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.551100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.551100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.551100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.551236] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.744226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.744642] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.744642] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.744837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.744937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.745054] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c is going to be updated. [ 646.783683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.783851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.783900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.784111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.785029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.795213] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: IN_PROGRESS for 2s [ 646.835785] env[65087]: INFO networking_nsxv3.common.synchronization [req-24b82cef-cbb6-477e-9f19-7f1d5a724abb req-89ebce15-7c21-438b-a8ee-b2db6072bdb8 tempest-ServersWithSpecificFlavorTestJSON-635744001 tempest-ServersWithSpecificFlavorTestJSON-635744001-project-member] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 646.838882] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 646.838882] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.838882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.838882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.838882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.838882] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.838882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.838882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.838882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.838882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.838882] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.982428] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.984121] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.984121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.984121] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 226d90d4-6acd-461c-91eb-55fea113ddaf with status ACTIVE [ 646.984370] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.984557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.984627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.984886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.985021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.985877] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.985980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.986052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.986311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.986425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.986939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.987112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.987205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.987483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.987608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.987745] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 226d90d4-6acd-461c-91eb-55fea113ddaf is going to be updated. [ 647.012186] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.012477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.012577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.012854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.013865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.015406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.054419] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3c0a5a-197c-4c4c-a82b-9342302fe922: rpc.has_security_group_logging(os_id): False [ 647.077308] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.077453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.077532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.077742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.077837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.078102] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.078163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.078219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.078374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.078459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.080358] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.080358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.081967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.081967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.082130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.082649] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.082826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.082905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.083093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.083176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.083294] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 647.197127] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.197404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.197474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.197951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.197951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.218279] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 647.340733] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.343339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.343451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.343684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.343780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.344079] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.344223] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.344282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.346418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.346548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.346996] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 already deleted. [ 647.346996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.349775] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-788 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.349940] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-788" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.350036] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-788" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.350714] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-788" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.350714] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.350902] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.351180] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.351265] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.351459] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.351697] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.351816] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.351926] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.352090] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.352184] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.352353] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.352518] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.389867] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.390119] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.390462] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.390462] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-788" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.391025] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.391226] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.391345] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.391687] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.391825] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dbae605-31c4-417e-bac6-c6a9f46ec7e2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.490679] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.895180] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.895553] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.895772] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.896414] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.896414] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.896615] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 8dbae605-31c4-417e-bac6-c6a9f46ec7e2 not found, creating... [ 647.897026] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.897168] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.897243] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.897614] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.897849] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.898360] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.898611] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.898792] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.899074] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.899241] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.899406] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 8dbae605-31c4-417e-bac6-c6a9f46ec7e2 is going to be created. [ 647.931810] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.932098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.932290] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.932643] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.932907] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.933224] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.967986] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: SUCCESS [ 647.968261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.994200] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.994472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.994472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.994683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.994788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.994938] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be created. [ 648.030210] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.030552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.030688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.031283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.031459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.148764] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: UNINITIALIZED for 2s [ 648.605145] env[65087]: INFO networking_nsxv3.common.synchronization [req-24b82cef-cbb6-477e-9f19-7f1d5a724abb req-f044b90d-7ea3-4990-8e1b-1b0a5dbb0066 service nova] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_rules [ 648.605145] env[65087]: INFO networking_nsxv3.common.synchronization [req-24b82cef-cbb6-477e-9f19-7f1d5a724abb req-f044b90d-7ea3-4990-8e1b-1b0a5dbb0066 service nova] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 648.605145] env[65087]: INFO networking_nsxv3.common.synchronization [req-24b82cef-cbb6-477e-9f19-7f1d5a724abb req-f044b90d-7ea3-4990-8e1b-1b0a5dbb0066 service nova] Enqueued Resource ID: 8dbae605-31c4-417e-bac6-c6a9f46ec7e2 with Priority: HIGHEST for action port [ 648.605145] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_rules [ 648.605145] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 648.606163] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dbae605-31c4-417e-bac6-c6a9f46ec7e2 with Priority: HIGHEST for action port [ 648.607111] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.612306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.612306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.612306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.612306] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.612306] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.612306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.612306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.612306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.612306] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.613453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.613508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.614802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.614802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.614802] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.614802] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.615029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.615029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.615725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.615725] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dbae605-31c4-417e-bac6-c6a9f46ec7e2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.808041] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: SUCCESS [ 648.808419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.808669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.809029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.809235] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.810137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.810658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.811014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.811621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.811817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.811983] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.941442] env[65087]: INFO networking_nsxv3.common.synchronization [req-18fd18aa-0527-47f1-b2d8-8cb06a788276 req-c9caa330-dcff-4982-8eb9-9346baa04f1b tempest-SecurityGroupRulesTestJSON-615434589 tempest-SecurityGroupRulesTestJSON-615434589-project-member] Enqueued Resource ID: 1aaa161b-5cd7-4b5b-87a7-68c198c92359 with Priority: HIGHEST for action security_group_rules [ 648.941588] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aaa161b-5cd7-4b5b-87a7-68c198c92359 with Priority: HIGHEST for action security_group_rules [ 648.941972] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1aaa161b-5cd7-4b5b-87a7-68c198c92359 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.942804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1aaa161b-5cd7-4b5b-87a7-68c198c92359" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.943103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1aaa161b-5cd7-4b5b-87a7-68c198c92359" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.943785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1aaa161b-5cd7-4b5b-87a7-68c198c92359" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.943785] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1aaa161b-5cd7-4b5b-87a7-68c198c92359',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.119166] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.119166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.119166] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.119884] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dbae605-31c4-417e-bac6-c6a9f46ec7e2 with status ACTIVE [ 649.120088] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.120236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.120304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.120522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.120600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.120793] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.120870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.120929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.121096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.121174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.121349] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.121444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.121504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.121639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.121710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.121791] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dbae605-31c4-417e-bac6-c6a9f46ec7e2 is going to be updated. [ 649.150973] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.151351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.151351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.151473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.151812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.151812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dbae605-31c4-417e-bac6-c6a9f46ec7e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.238918] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 649.239122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.315566] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.316533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.316533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.316533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.316533] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.316533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.316533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.316533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.319718] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.319718] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.319718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.319718] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.476191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.476191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.476191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.476191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.476191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.476191] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1aaa161b-5cd7-4b5b-87a7-68c198c92359 already deleted. [ 649.476191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1aaa161b-5cd7-4b5b-87a7-68c198c92359" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.510536] env[65087]: INFO networking_nsxv3.common.synchronization [req-6f5e511c-ffbd-4be7-860c-01ea397409a3 req-8faba3bf-e173-4767-a1d6-02e4e45e4fd6 tempest-ServerExternalEventsTest-803866803 tempest-ServerExternalEventsTest-803866803-project-member] Enqueued Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGHEST for action security_group_members [ 649.510536] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGHEST for action security_group_members [ 649.510536] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf51869e-19e4-466b-9282-9b2c63589cff taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.510536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.510536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.510536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.510536] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.510536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.510536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.511549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.511549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.511549] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.628469] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.820393] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fb66ad5-69f7-466f-94b1-24f53af1b70c: rpc.has_security_group_logging(os_id): False [ 649.841449] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.841627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.841694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.842036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.842201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.842572] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.842572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.842689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.842874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.842980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.843334] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.843496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.844132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.844367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.844567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.844961] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.844961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.844961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.845285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.845285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.845404] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c is going to be updated. [ 649.912131] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.912424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.912424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.912798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.913162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.933572] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: IN_PROGRESS for 2s [ 650.018677] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.018896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.018997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.019283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.019401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.019653] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.019800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.019912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.020106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.020202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.020322] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf51869e-19e4-466b-9282-9b2c63589cff already deleted. [ 650.020432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.131782] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.131964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.132055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.132242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.132394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.132505] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 is going to be created. [ 650.162723] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 650.163106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.163364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.163637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.163911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.164097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.164224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.164512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.164753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.164831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.164929] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.167550] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.167728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.167831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.168190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.169015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.172785] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.172953] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.173086] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.173335] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.173603] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.173756] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.173863] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.174079] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.174213] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.176533] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.176533] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.176533] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.176856] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.176965] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.177068] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.177207] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.187420] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: UNINITIALIZED for 2s [ 650.207991] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.208176] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.208308] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.208488] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.208926] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-7d25181d-c295-496e-a24f-b3ae6a4e529c taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.209337] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-7d25181d-c295-496e-a24f-b3ae6a4e529c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.209572] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-7d25181d-c295-496e-a24f-b3ae6a4e529c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.209916] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-7d25181d-c295-496e-a24f-b3ae6a4e529c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.210228] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d25181d-c295-496e-a24f-b3ae6a4e529c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.672371] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.713214] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.713493] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.713569] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.713945] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.714117] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.714271] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 7d25181d-c295-496e-a24f-b3ae6a4e529c not found, creating... [ 650.714545] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.714710] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.714820] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.715055] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.715190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.715486] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.715645] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.715757] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.715963] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.716107] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.716286] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 7d25181d-c295-496e-a24f-b3ae6a4e529c is going to be created. [ 650.753916] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.754215] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.754418] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.754882] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.755225] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.756370] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-7d25181d-c295-496e-a24f-b3ae6a4e529c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.175226] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68: rpc.has_security_group_logging(os_id): False [ 651.201015] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.201467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.201467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.201628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.201761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.202068] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.202234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.202388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.202526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.202610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.202698] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be created. [ 651.288187] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.288421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.288502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.288783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.288986] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.323810] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: IN_PROGRESS for 2s [ 651.481775] env[65087]: INFO networking_nsxv3.common.synchronization [req-6f5e511c-ffbd-4be7-860c-01ea397409a3 req-95b10922-50eb-442a-80fb-92e6e1386de4 service nova] Enqueued Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGHEST for action security_group_rules [ 651.481775] env[65087]: INFO networking_nsxv3.common.synchronization [req-6f5e511c-ffbd-4be7-860c-01ea397409a3 req-95b10922-50eb-442a-80fb-92e6e1386de4 service nova] Enqueued Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGHEST for action security_group_members [ 651.481775] env[65087]: INFO networking_nsxv3.common.synchronization [req-6f5e511c-ffbd-4be7-860c-01ea397409a3 req-95b10922-50eb-442a-80fb-92e6e1386de4 service nova] Enqueued Resource ID: 7d25181d-c295-496e-a24f-b3ae6a4e529c with Priority: HIGHEST for action port [ 651.481775] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGHEST for action security_group_rules [ 651.481775] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGHEST for action security_group_members [ 651.481775] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d25181d-c295-496e-a24f-b3ae6a4e529c with Priority: HIGHEST for action port [ 651.482425] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf51869e-19e4-466b-9282-9b2c63589cff taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.482425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.482515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.482822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.482822] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.484316] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf51869e-19e4-466b-9282-9b2c63589cff taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.484484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.484533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.484753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.484913] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.485026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.485091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.485255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.485350] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.485447] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.486614] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d25181d-c295-496e-a24f-b3ae6a4e529c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.486741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d25181d-c295-496e-a24f-b3ae6a4e529c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.486811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d25181d-c295-496e-a24f-b3ae6a4e529c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.486979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d25181d-c295-496e-a24f-b3ae6a4e529c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.487209] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d25181d-c295-496e-a24f-b3ae6a4e529c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.751608] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c3fd71ed-8a3d-4aaf-9908-a1e5e29b3a4f None None] Enqueued Resource ID: ac605a22-3fc4-4893-b379-17f01491f16b with Priority: HIGHEST for action port [ 651.751858] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac605a22-3fc4-4893-b379-17f01491f16b with Priority: HIGHEST for action port [ 651.752485] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac605a22-3fc4-4893-b379-17f01491f16b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.752604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac605a22-3fc4-4893-b379-17f01491f16b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.752673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac605a22-3fc4-4893-b379-17f01491f16b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.752936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac605a22-3fc4-4893-b379-17f01491f16b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.753850] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac605a22-3fc4-4893-b379-17f01491f16b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.983074] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: SUCCESS [ 651.983448] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.988908] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d25181d-c295-496e-a24f-b3ae6a4e529c with status ACTIVE [ 651.989154] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.989297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.989381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.989581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.989675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.989858] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.989962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.990045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.990207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.990310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.990505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.990603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.990668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.990815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.990887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.990970] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d25181d-c295-496e-a24f-b3ae6a4e529c is going to be updated. [ 651.992170] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf51869e-19e4-466b-9282-9b2c63589cff taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.992322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.992459] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.027160] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.027574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.027574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.027886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.028141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.028336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d25181d-c295-496e-a24f-b3ae6a4e529c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.206465] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: SUCCESS [ 652.206465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.206465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.206465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.206465] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.206465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.206465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.207043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.207043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.207043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.207700] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.257253] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac605a22-3fc4-4893-b379-17f01491f16b [ 652.257497] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.257627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.257695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.258172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.258172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.258172] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac605a22-3fc4-4893-b379-17f01491f16b already deleted. [ 652.258172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac605a22-3fc4-4893-b379-17f01491f16b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.498639] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.711595] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.001220] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.001373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.001458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.001689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.001784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.001883] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf51869e-19e4-466b-9282-9b2c63589cff is going to be created. [ 653.035117] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.035117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.035117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.035117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.035869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.052981] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf51869e-19e4-466b-9282-9b2c63589cff in Status: UNINITIALIZED for 2s [ 653.081171] env[65087]: INFO networking_nsxv3.common.synchronization [req-e1f06cdf-61dc-4018-b6ab-7d5d1008ff65 req-740ccfcd-243c-4029-9b5f-0965a472e604 tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 with Priority: HIGHEST for action security_group_members [ 653.082028] env[65087]: INFO networking_nsxv3.common.synchronization [req-e1f06cdf-61dc-4018-b6ab-7d5d1008ff65 req-740ccfcd-243c-4029-9b5f-0965a472e604 tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 653.082157] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 with Priority: HIGHEST for action security_group_members [ 653.082246] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 653.082754] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-11590a48-d7e7-4f08-a58d-17e57b9e8047 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.082754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.082754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.083033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.083203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.083352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.083415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.083573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.083740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.083887] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.085246] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.085352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.085392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.085625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.085702] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.085819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.085870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.086068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.086230] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.086385] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.153941] env[65087]: INFO networking_nsxv3.common.synchronization [req-e1f06cdf-61dc-4018-b6ab-7d5d1008ff65 req-740ccfcd-243c-4029-9b5f-0965a472e604 tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_rules [ 653.154395] env[65087]: INFO networking_nsxv3.common.synchronization [req-e1f06cdf-61dc-4018-b6ab-7d5d1008ff65 req-740ccfcd-243c-4029-9b5f-0965a472e604 tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 653.158112] env[65087]: INFO networking_nsxv3.common.synchronization [req-e1f06cdf-61dc-4018-b6ab-7d5d1008ff65 req-740ccfcd-243c-4029-9b5f-0965a472e604 tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 with Priority: HIGHEST for action security_group_rules [ 653.158112] env[65087]: INFO networking_nsxv3.common.synchronization [req-e1f06cdf-61dc-4018-b6ab-7d5d1008ff65 req-740ccfcd-243c-4029-9b5f-0965a472e604 tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 with Priority: HIGHEST for action security_group_members [ 653.158112] env[65087]: INFO networking_nsxv3.common.synchronization [req-e1f06cdf-61dc-4018-b6ab-7d5d1008ff65 req-740ccfcd-243c-4029-9b5f-0965a472e604 tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf with Priority: HIGHEST for action port [ 653.158112] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_rules [ 653.158112] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 with Priority: HIGHEST for action security_group_rules [ 653.158112] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf with Priority: HIGHEST for action port [ 653.158112] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 653.158112] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 with Priority: HIGHEST for action security_group_members [ 653.158112] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.158112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.158112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.158112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.158112] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.159755] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11590a48-d7e7-4f08-a58d-17e57b9e8047 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.160132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.160352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.160768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.161075] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.162720] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.163034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.163339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.163705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.163959] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cba7e19e-a17d-4ce4-85a5-b268b9debdbf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.165619] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.167379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.167379] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-11590a48-d7e7-4f08-a58d-17e57b9e8047 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.167379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.217029] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b5dadcb-8f3a-482e-b14c-24a6ef163d88: rpc.has_security_group_logging(os_id): False [ 653.236357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.236600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.236600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.237566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.237566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.237566] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.237566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.237566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.237995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.237995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.237995] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 is going to be created. [ 653.344187] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.344187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.344187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.344460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.344597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.346828] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 653.347104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.358382] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: IN_PROGRESS for 2s [ 653.588258] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.589589] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.668187] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-11590a48-d7e7-4f08-a58d-17e57b9e8047 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.668346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.668500] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cba7e19e-a17d-4ce4-85a5-b268b9debdbf with status ACTIVE [ 653.668675] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.668802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.668875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.669072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.669164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.669332] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.669436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.669500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.669658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.669738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.669913] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.670015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.670086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.670256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.670344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.670433] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf is going to be updated. [ 653.672344] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.672482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.692380] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.692550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.692621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.692828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.692968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.693141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.091570] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.093698] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.526825] env[65087]: INFO networking_nsxv3.common.synchronization [None req-55cb1d64-246d-496e-adcb-a4774a6ac30c None None] Enqueued Resource ID: 990b642d-69c4-4e3b-8d81-1d572fa9f1c6 with Priority: HIGHEST for action port [ 654.527449] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 990b642d-69c4-4e3b-8d81-1d572fa9f1c6 with Priority: HIGHEST for action port [ 654.527700] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-990b642d-69c4-4e3b-8d81-1d572fa9f1c6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.527855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-990b642d-69c4-4e3b-8d81-1d572fa9f1c6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.528601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-990b642d-69c4-4e3b-8d81-1d572fa9f1c6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.528601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-990b642d-69c4-4e3b-8d81-1d572fa9f1c6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.528601] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('990b642d-69c4-4e3b-8d81-1d572fa9f1c6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.595995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.596247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.596247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.596485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.596581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.596678] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be updated. [ 654.598046] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.598169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.598239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.598412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.598499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.598658] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 is going to be created. [ 654.632789] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.633337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.633560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.634075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.634416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.645597] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.646542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.646542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.646542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.647161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.649623] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 in Status: UNINITIALIZED for 2s [ 654.658174] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: IN_PROGRESS for 2s [ 654.869105] env[65087]: INFO networking_nsxv3.common.synchronization [req-d745d153-5437-4ee5-9a2c-a3ee8a57a07b req-6e93a5be-134e-43d8-b46d-32ffcc99cb6f tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 with Priority: HIGHEST for action security_group_members [ 654.869105] env[65087]: INFO networking_nsxv3.common.synchronization [req-d745d153-5437-4ee5-9a2c-a3ee8a57a07b req-6e93a5be-134e-43d8-b46d-32ffcc99cb6f tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 654.869105] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 with Priority: HIGHEST for action security_group_members [ 654.869105] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 654.869105] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-11590a48-d7e7-4f08-a58d-17e57b9e8047 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.869105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.869748] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.870019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.940404] env[65087]: INFO networking_nsxv3.common.synchronization [req-d745d153-5437-4ee5-9a2c-a3ee8a57a07b req-6e93a5be-134e-43d8-b46d-32ffcc99cb6f tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_rules [ 654.940580] env[65087]: INFO networking_nsxv3.common.synchronization [req-d745d153-5437-4ee5-9a2c-a3ee8a57a07b req-6e93a5be-134e-43d8-b46d-32ffcc99cb6f tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 654.940716] env[65087]: INFO networking_nsxv3.common.synchronization [req-d745d153-5437-4ee5-9a2c-a3ee8a57a07b req-6e93a5be-134e-43d8-b46d-32ffcc99cb6f tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf with Priority: HIGHEST for action port [ 654.944622] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_rules [ 654.944622] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 654.944622] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf with Priority: HIGHEST for action port [ 654.944622] env[65087]: INFO networking_nsxv3.common.synchronization [req-caa28a69-ea41-421c-8602-fd58d0053107 req-90ba8f80-ce40-4059-a148-2d2d131fd3a4 tempest-SecurityGroupRulesTestJSON-615434589 tempest-SecurityGroupRulesTestJSON-615434589-project-member] Enqueued Resource ID: 82230f35-b7b5-480e-958f-443eefda6dce with Priority: HIGHEST for action security_group_rules [ 654.945141] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.945457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.945457] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.945604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.945720] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.945807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.945870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.946981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.947113] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cba7e19e-a17d-4ce4-85a5-b268b9debdbf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.948934] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82230f35-b7b5-480e-958f-443eefda6dce with Priority: HIGHEST for action security_group_rules [ 654.948934] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82230f35-b7b5-480e-958f-443eefda6dce taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.949139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82230f35-b7b5-480e-958f-443eefda6dce" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.949139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82230f35-b7b5-480e-958f-443eefda6dce" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.949382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82230f35-b7b5-480e-958f-443eefda6dce" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.949537] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82230f35-b7b5-480e-958f-443eefda6dce',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.034040] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 990b642d-69c4-4e3b-8d81-1d572fa9f1c6 [ 655.036029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.036029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.036029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.036029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.036029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.036461] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:990b642d-69c4-4e3b-8d81-1d572fa9f1c6 already deleted. [ 655.036461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-990b642d-69c4-4e3b-8d81-1d572fa9f1c6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.066338] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf51869e-19e4-466b-9282-9b2c63589cff in Status: SUCCESS [ 655.067076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.067330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.070308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.070594] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.070736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.070814] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.071588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.071588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.071588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.071588] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.376978] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: SUCCESS [ 655.378117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.451706] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cba7e19e-a17d-4ce4-85a5-b268b9debdbf with status ACTIVE [ 655.454951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.456165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.456165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.456596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.458363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.460257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.461675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.463018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.463018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.463018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.463387] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.463508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.463552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.463764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.464037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.464037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cba7e19e-a17d-4ce4-85a5-b268b9debdbf is going to be updated. [ 655.489374] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.489374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.489374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.489374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.489374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.489374] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82230f35-b7b5-480e-958f-443eefda6dce already deleted. [ 655.489865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82230f35-b7b5-480e-958f-443eefda6dce" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.499864] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.500109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.500177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.500522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.500629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.501860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cba7e19e-a17d-4ce4-85a5-b268b9debdbf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.578497] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf51869e-19e4-466b-9282-9b2c63589cff taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.578951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.578951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.579842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.579842] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.579842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.579842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.580196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.580196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.580196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.580529] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf51869e-19e4-466b-9282-9b2c63589cff taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.580607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.581383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.581383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.581383] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.581383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.581383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.582689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.582689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.582689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.582689] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.644309] env[65087]: INFO networking_nsxv3.common.synchronization [req-04746ea6-5001-4d95-ba02-aec2a3e9cddc req-36d64472-a1a8-4bb8-b0e2-6a7fdda5b32d tempest-ServerDiagnosticsNegativeTest-1189625242 tempest-ServerDiagnosticsNegativeTest-1189625242-project-member] Enqueued Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGHEST for action security_group_members [ 655.645183] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGHEST for action security_group_members [ 655.648372] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44c5dff-d003-41a8-874e-8ad81c2de7ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.648372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.648372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.648372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.648372] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.648372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.648372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.648372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.648372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.648372] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.043106] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.043328] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.043457] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.043764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.044056] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.044282] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.044481] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.045065] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.045165] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.045343] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.046061] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.046061] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.046061] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.046061] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.046061] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.046280] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.067290] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.067511] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.067652] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.067826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.068201] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-336db5c9-4420-4f53-8ec9-8867cdb029a2 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.068397] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-336db5c9-4420-4f53-8ec9-8867cdb029a2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.068517] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-336db5c9-4420-4f53-8ec9-8867cdb029a2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.068905] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-336db5c9-4420-4f53-8ec9-8867cdb029a2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.069127] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336db5c9-4420-4f53-8ec9-8867cdb029a2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.084912] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf51869e-19e4-466b-9282-9b2c63589cff: rpc.has_security_group_logging(os_id): False [ 656.107707] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.107950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.108025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.108271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.108393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.108685] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.108880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.108978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.109308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.109429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.109681] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.109854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.109931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.110181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.110335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.110628] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.110734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.110833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.111094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.111222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.111382] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf51869e-19e4-466b-9282-9b2c63589cff is going to be created. [ 656.151062] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.151270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.151343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.151634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.151735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.151944] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.152091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.152210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.152425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.152531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.152624] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca already deleted. [ 656.152713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.227640] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.227640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.227640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.227640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.227640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.244148] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf51869e-19e4-466b-9282-9b2c63589cff in Status: IN_PROGRESS for 2s [ 656.308582] env[65087]: INFO networking_nsxv3.common.synchronization [req-04b9375e-8da3-4646-80ca-42ed2c0a31be req-eba9366b-18b8-4328-aedb-86e6fe37a799 tempest-VolumesAdminNegativeTest-828988360 tempest-VolumesAdminNegativeTest-828988360-project-member] Enqueued Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGHEST for action security_group_members [ 656.309419] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGHEST for action security_group_members [ 656.312099] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.312099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.312099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.312099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.312099] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.312099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.312099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.312099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.312099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.312637] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.572553] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.572553] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.572889] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.573143] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.574049] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.574049] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 336db5c9-4420-4f53-8ec9-8867cdb029a2 not found, creating... [ 656.574049] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.574049] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.574265] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.574488] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.574700] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.575061] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.575248] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.575361] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.575759] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.575909] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.576306] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 336db5c9-4420-4f53-8ec9-8867cdb029a2 is going to be created. [ 656.601035] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.601035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.601035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.601035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.601035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.601035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-336db5c9-4420-4f53-8ec9-8867cdb029a2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.622577] env[65087]: INFO networking_nsxv3.common.synchronization [req-680ec093-443b-4ae5-bd80-a18c9c3a3b08 req-2d11bdd9-c3de-47ad-86cb-cae9006f45cf tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 656.623207] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 656.627027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.627027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.627027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.627027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.627027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.627027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.627027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.627027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.627027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.627027] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.658950] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 in Status: SUCCESS [ 656.659151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.660408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.660646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.660839] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.660961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.661046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.661194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.661278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.661374] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.670398] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 656.670398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.670398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.670398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.670637] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.670637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.670637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.670816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.670849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.671195] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.817720] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.817903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.817961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.818183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.818289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.818481] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.818583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.818661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.818842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.818906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.818974] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd is going to be updated. [ 656.858909] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.859126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.859126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.859403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.859497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.871844] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd in Status: IN_PROGRESS for 2s [ 657.127350] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.127613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.127714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.128010] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.128122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.128395] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.128533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.128595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.128809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.128892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.129191] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 657.164173] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.164453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.164585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.164931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.166369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.166369] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.166369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.166369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.166369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.166369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.166369] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 is going to be deleted. [ 657.173746] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.173962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.174087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.174376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.174605] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.176351] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.187696] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 657.247998] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.247998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.247998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.247998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.247998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.247998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.247998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.251013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.251341] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.251341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.251486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.251779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.251779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.253126] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.488641] env[65087]: INFO networking_nsxv3.common.synchronization [req-04746ea6-5001-4d95-ba02-aec2a3e9cddc req-33cd8dd3-8c16-4087-81a0-497cf3952276 service nova] Enqueued Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGHEST for action security_group_rules [ 657.488641] env[65087]: INFO networking_nsxv3.common.synchronization [req-04746ea6-5001-4d95-ba02-aec2a3e9cddc req-33cd8dd3-8c16-4087-81a0-497cf3952276 service nova] Enqueued Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGHEST for action security_group_members [ 657.488641] env[65087]: INFO networking_nsxv3.common.synchronization [req-04746ea6-5001-4d95-ba02-aec2a3e9cddc req-33cd8dd3-8c16-4087-81a0-497cf3952276 service nova] Enqueued Resource ID: 336db5c9-4420-4f53-8ec9-8867cdb029a2 with Priority: HIGHEST for action port [ 657.489000] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGHEST for action security_group_rules [ 657.489000] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGHEST for action security_group_members [ 657.489171] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336db5c9-4420-4f53-8ec9-8867cdb029a2 with Priority: HIGHEST for action port [ 657.489397] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.489521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.489621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.489845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.489936] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.491140] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44c5dff-d003-41a8-874e-8ad81c2de7ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.491140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.491140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.491395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.491395] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.491651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.491651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.491651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.493557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.493557] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.493557] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-336db5c9-4420-4f53-8ec9-8867cdb029a2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.493557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-336db5c9-4420-4f53-8ec9-8867cdb029a2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.493557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-336db5c9-4420-4f53-8ec9-8867cdb029a2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.493557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-336db5c9-4420-4f53-8ec9-8867cdb029a2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.493557] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336db5c9-4420-4f53-8ec9-8867cdb029a2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.682443] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.758581] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.758788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.758838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.759037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.759168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.759586] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.759586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.759586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.759829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.759829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.759896] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 already deleted. [ 657.759930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.760079] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.761011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.764097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.764334] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.764476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.764605] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.764911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.764911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.765642] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.997241] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44c5dff-d003-41a8-874e-8ad81c2de7ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.997241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.997241] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.997241] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 336db5c9-4420-4f53-8ec9-8867cdb029a2 with status ACTIVE [ 657.997241] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.997775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.997775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.997775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.997775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.997950] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.997950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.998101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.998197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.998241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.998414] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.998504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.998566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.998748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.998839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.998924] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 336db5c9-4420-4f53-8ec9-8867cdb029a2 is going to be updated. [ 658.017557] env[65087]: INFO networking_nsxv3.common.synchronization [req-7a4eff13-0063-46a3-93f5-f9d0272c7944 req-33ed72ec-e4aa-41c7-b861-dcc5112db7c0 tempest-ServersNegativeTestMultiTenantJSON-1371931673 tempest-ServersNegativeTestMultiTenantJSON-1371931673-project-member] Enqueued Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGHEST for action security_group_members [ 658.020362] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGHEST for action security_group_members [ 658.020362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-df9bb938-6d5d-4fc7-8385-f402075d6859 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.020362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.020362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.020362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.020362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.190871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.191079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.191237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.191343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.191457] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.194521] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.195026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.195026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.195026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.195371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.196957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-336db5c9-4420-4f53-8ec9-8867cdb029a2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.197222] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.197222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.197390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.197487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.197831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.197831] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be updated. [ 658.233746] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.233997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.233997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.234227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.234450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.247936] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: IN_PROGRESS for 2s [ 658.259357] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf51869e-19e4-466b-9282-9b2c63589cff in Status: SUCCESS [ 658.259770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.268105] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11590a48-d7e7-4f08-a58d-17e57b9e8047',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.269897] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.269897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.269897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.269897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.269897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.270182] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.270237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.270422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.271168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.271168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.271168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 already deleted. [ 658.271168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.337974] env[65087]: INFO networking_nsxv3.common.synchronization [req-939d0fba-2fad-484e-a1da-d3153b8682ca req-256d275e-755f-474d-9526-f66080125a0f tempest-TenantUsagesTestJSON-201675620 tempest-TenantUsagesTestJSON-201675620-project-member] Enqueued Resource ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 with Priority: HIGHEST for action security_group_members [ 658.337974] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 with Priority: HIGHEST for action security_group_members [ 658.338340] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-de120ad0-cbd8-47c5-85f0-73d798da60f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.338340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.338558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.338783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.339015] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.339145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.339210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.339401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.339499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.339634] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de120ad0-cbd8-47c5-85f0-73d798da60f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.505562] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.702747] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.702747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.702747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.702747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.703181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.704237] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.704353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.704406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.704705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.704786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.704911] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9bb938-6d5d-4fc7-8385-f402075d6859 is going to be updated. [ 658.769016] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.769016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.769016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.769016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.769016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.772743] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11590a48-d7e7-4f08-a58d-17e57b9e8047: rpc.has_security_group_logging(os_id): False [ 658.779924] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9bb938-6d5d-4fc7-8385-f402075d6859 in Status: IN_PROGRESS for 2s [ 658.793258] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.793500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.793500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.793712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.793828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.794068] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.794173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.794236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.794397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.794477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.794560] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 is going to be created. [ 658.816547] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/11590a48-d7e7-4f08-a58d-17e57b9e8047], does not exist path=[/infra/domains/default/groups/11590a48-d7e7-4f08-a58d-17e57b9e8047]."\n}' [ 658.816678] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/11590a48-d7e7-4f08-a58d-17e57b9e8047 [ 658.816770] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 658.841912] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.842103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.842178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.842441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.842572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.842744] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.842847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.842920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.843165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.843267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.843375] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 is going to be updated. [ 658.868737] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.868892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.868966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.869196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.870009] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.870290] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.870408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.870476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.870643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.870724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.870945] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.871058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.871281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.871281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.871513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.871513] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11590a48-d7e7-4f08-a58d-17e57b9e8047 is going to be created. [ 658.894264] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.894264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.894484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.894558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.894718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.896895] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd in Status: SUCCESS [ 658.897075] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd deletion is rescheduled due to dependency. [ 658.897231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.909948] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 in Status: IN_PROGRESS for 2s [ 658.913035] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/11590a48-d7e7-4f08-a58d-17e57b9e8047], does not exist path=[/infra/domains/default/groups/11590a48-d7e7-4f08-a58d-17e57b9e8047]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/11590a48-d7e7-4f08-a58d-17e57b9e8047 [ 658.913247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11590a48-d7e7-4f08-a58d-17e57b9e8047" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.914758] env[65087]: Traceback (most recent call last): [ 658.914758] env[65087]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 658.914758] env[65087]: return func(*args, **kwargs) [ 658.914758] env[65087]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 658.914758] env[65087]: res.raise_for_status() [ 658.914758] env[65087]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 658.914758] env[65087]: raise HTTPError(http_error_msg, response=self) [ 658.914758] env[65087]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/11590a48-d7e7-4f08-a58d-17e57b9e8047 [ 658.914758] env[65087]: During handling of the above exception, another exception occurred: [ 658.914758] env[65087]: Traceback (most recent call last): [ 658.914758] env[65087]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 658.914758] env[65087]: listener.cb(fileno) [ 658.914758] env[65087]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 658.914758] env[65087]: result = function(*args, **kwargs) [ 658.914758] env[65087]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 658.914758] env[65087]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 658.914758] env[65087]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 658.914758] env[65087]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 658.914758] env[65087]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 658.914758] env[65087]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 658.914758] env[65087]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 658.914758] env[65087]: res.raise_for_status() [ 658.914758] env[65087]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 658.914758] env[65087]: raise HTTPError(http_error_msg, response=self) [ 658.914758] env[65087]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/11590a48-d7e7-4f08-a58d-17e57b9e8047 [ 658.914758] env[65087]: Removing descriptor: 5 [ 659.009850] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.010048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.010048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.010529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.010624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.010729] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca is going to be created. [ 659.043669] env[65087]: INFO networking_nsxv3.common.synchronization [req-bc7cfc3c-d856-41e5-86ab-1620eefbd3e6 req-35519aa7-7e3d-4d56-ada4-285071c50c76 tempest-ServersTestJSON-1091804776 tempest-ServersTestJSON-1091804776-project-member] Enqueued Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_members [ 659.043669] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.043669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.043669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.044022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.044312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.046604] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_members [ 659.047216] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.047532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.047942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.048438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.048846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.049114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.049298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.049590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.049819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.050023] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.062517] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca in Status: UNINITIALIZED for 2s [ 659.201794] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 659.201959] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 deletion is rescheduled due to dependency. [ 659.202063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.554246] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.554246] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.554492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.554643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.554771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.555378] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.555529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.555644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.555903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.555903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.556092] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 already deleted. [ 659.556464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.863022] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-743 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.863022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-743" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.863022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-743" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.863022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-743" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.863022] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.863022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.863022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.863022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.863022] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.863022] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.863022] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.863022] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.863022] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.863834] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.863834] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.863834] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.884593] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.884947] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.885173] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.885397] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-743" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.885819] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-88fa77c2-3feb-44e8-be3b-0d54598c6202 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.886097] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-88fa77c2-3feb-44e8-be3b-0d54598c6202" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.886269] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-88fa77c2-3feb-44e8-be3b-0d54598c6202" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.886654] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-88fa77c2-3feb-44e8-be3b-0d54598c6202" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.886834] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88fa77c2-3feb-44e8-be3b-0d54598c6202',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.263940] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 660.264176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.264364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.264627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.264795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.265061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.265061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.265233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.265233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.265350] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.265516] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.268624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.268807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.268911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.269153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.271197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.271388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.271516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.271616] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.390279] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.390555] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.390679] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.390956] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.391122] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.391275] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 88fa77c2-3feb-44e8-be3b-0d54598c6202 not found, creating... [ 660.391585] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.391769] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.391855] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.392085] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.392216] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.392566] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.392763] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.392826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.393019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.393471] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.393564] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 88fa77c2-3feb-44e8-be3b-0d54598c6202 is going to be created. [ 660.416243] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.416462] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.416559] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.416826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.417058] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.417286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-88fa77c2-3feb-44e8-be3b-0d54598c6202" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.769890] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.769890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.779030] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.793309] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df9bb938-6d5d-4fc7-8385-f402075d6859 in Status: SUCCESS [ 660.793488] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df9bb938-6d5d-4fc7-8385-f402075d6859 deletion is rescheduled due to dependency. [ 660.793649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.921266] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 in Status: SUCCESS [ 660.921700] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de120ad0-cbd8-47c5-85f0-73d798da60f8 deletion is rescheduled due to dependency. [ 660.921867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de120ad0-cbd8-47c5-85f0-73d798da60f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.076913] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca in Status: SUCCESS [ 661.077192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.077388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.078110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.078110] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.078316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.078426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.078686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.078766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.078896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.079043] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.247025] env[65087]: INFO networking_nsxv3.common.synchronization [req-bc7cfc3c-d856-41e5-86ab-1620eefbd3e6 req-4dac5afd-0e2c-4fe1-a459-b2160200603a service nova] Enqueued Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_rules [ 661.247025] env[65087]: INFO networking_nsxv3.common.synchronization [req-bc7cfc3c-d856-41e5-86ab-1620eefbd3e6 req-4dac5afd-0e2c-4fe1-a459-b2160200603a service nova] Enqueued Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_members [ 661.247025] env[65087]: INFO networking_nsxv3.common.synchronization [req-bc7cfc3c-d856-41e5-86ab-1620eefbd3e6 req-4dac5afd-0e2c-4fe1-a459-b2160200603a service nova] Enqueued Resource ID: 88fa77c2-3feb-44e8-be3b-0d54598c6202 with Priority: HIGHEST for action port [ 661.247025] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_rules [ 661.247025] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_members [ 661.247025] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88fa77c2-3feb-44e8-be3b-0d54598c6202 with Priority: HIGHEST for action port [ 661.247025] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.247025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.247025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.247025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.247025] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.249724] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.249951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.250090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.250352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.250638] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.251586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.251586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.251586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.251586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.252082] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.253351] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-88fa77c2-3feb-44e8-be3b-0d54598c6202 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.253351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88fa77c2-3feb-44e8-be3b-0d54598c6202" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.253351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88fa77c2-3feb-44e8-be3b-0d54598c6202" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.253754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88fa77c2-3feb-44e8-be3b-0d54598c6202" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.253999] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88fa77c2-3feb-44e8-be3b-0d54598c6202',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.282013] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.581429] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44c5dff-d003-41a8-874e-8ad81c2de7ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.581594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.581667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.585353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.585598] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.585764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.585837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.586029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.586136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.586216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.586381] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44c5dff-d003-41a8-874e-8ad81c2de7ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.586478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.586563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.586680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.586818] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.586908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.586967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.587120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.587195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.587274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.587363] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.756182] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.756296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.757041] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88fa77c2-3feb-44e8-be3b-0d54598c6202 with status ACTIVE [ 661.757041] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.757041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.757041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.757041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.757439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.757439] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.757439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.757439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.757838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.757838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.757838] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.758277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.758277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.758277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.758277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.758488] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88fa77c2-3feb-44e8-be3b-0d54598c6202 is going to be updated. [ 661.762961] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.871822] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88fa77c2-3feb-44e8-be3b-0d54598c6202" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.871822] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.871822] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be updated. [ 661.871822] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.871822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.874807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.874807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.874807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.874807] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: IN_PROGRESS for 2s [ 662.089827] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f44c5dff-d003-41a8-874e-8ad81c2de7ca: rpc.has_security_group_logging(os_id): False [ 662.110761] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.110956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.110956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.111111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.111208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.111398] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.111502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.111560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.111721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.111798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.111987] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.112093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.112155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.112299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.112367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.113037] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.113037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.113037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.113037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.113037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.113318] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca is going to be created. [ 662.173852] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.173955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.174011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.174274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.174459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.186637] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca in Status: IN_PROGRESS for 2s [ 662.261784] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.765715] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.765931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.766190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.766514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.766635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.766760] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 is going to be created. [ 662.792619] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.792791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.793093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.793093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.794784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.805477] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 in Status: UNINITIALIZED for 2s [ 663.850174] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 663.850545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.851382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.852839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.853115] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.854744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.854744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.854744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.854744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.854744] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.202160] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca in Status: SUCCESS [ 664.202160] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.358706] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.815563] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 in Status: SUCCESS [ 664.815786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.815954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.816292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.816437] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.816637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.816637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.816818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.816910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.817639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.817639] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.861286] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.319756] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.367430] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.367430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.367430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.367430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.367430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.367430] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be updated. [ 665.402488] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.402488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.402488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.402488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.402488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.412346] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: IN_PROGRESS for 2s [ 665.824548] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5: rpc.has_security_group_logging(os_id): False [ 665.845116] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.845442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.845442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.845607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.845924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.846224] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.846372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.846463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.846614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.846697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.846791] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 is going to be created. [ 665.930392] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.930725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.930725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.931664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.931664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.940431] env[65087]: INFO networking_nsxv3.common.synchronization [req-e4125f43-80b1-489e-a1a8-aeaa8b687f43 req-95ff1e66-c231-406f-8e63-7e16f0ae56a2 tempest-SecurityGroupRulesTestJSON-615434589 tempest-SecurityGroupRulesTestJSON-615434589-project-member] Enqueued Resource ID: 0d004f1f-8f5e-4e1f-b628-6e6a962119d0 with Priority: HIGHEST for action security_group_rules [ 665.941263] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d004f1f-8f5e-4e1f-b628-6e6a962119d0 with Priority: HIGHEST for action security_group_rules [ 665.941718] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d004f1f-8f5e-4e1f-b628-6e6a962119d0 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.941806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d004f1f-8f5e-4e1f-b628-6e6a962119d0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.941854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d004f1f-8f5e-4e1f-b628-6e6a962119d0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.942142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d004f1f-8f5e-4e1f-b628-6e6a962119d0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.942227] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d004f1f-8f5e-4e1f-b628-6e6a962119d0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.947530] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 in Status: IN_PROGRESS for 2s [ 666.471432] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.471628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.471804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.471934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.472012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.472215] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d004f1f-8f5e-4e1f-b628-6e6a962119d0 already deleted. [ 666.472323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d004f1f-8f5e-4e1f-b628-6e6a962119d0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.982483] env[65087]: INFO networking_nsxv3.common.synchronization [None req-40b837ae-8e0f-4642-bdeb-3c87a40e75b1 None None] Enqueued Resource ID: ed533055-edc8-45df-94a7-840f2322bfb3 with Priority: HIGHEST for action port [ 666.983150] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed533055-edc8-45df-94a7-840f2322bfb3 with Priority: HIGHEST for action port [ 666.983540] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed533055-edc8-45df-94a7-840f2322bfb3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.983720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed533055-edc8-45df-94a7-840f2322bfb3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.985339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed533055-edc8-45df-94a7-840f2322bfb3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.985339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed533055-edc8-45df-94a7-840f2322bfb3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.985339] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed533055-edc8-45df-94a7-840f2322bfb3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.157087] env[65087]: INFO networking_nsxv3.common.synchronization [req-bdc11366-e4e7-414d-b0e4-99b3517e9c01 req-61ea0d01-227c-43a1-8032-4b81bf658e75 tempest-ServerAddressesNegativeTestJSON-1768156645 tempest-ServerAddressesNegativeTestJSON-1768156645-project-member] Enqueued Resource ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f with Priority: HIGHEST for action security_group_members [ 667.159354] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f with Priority: HIGHEST for action security_group_members [ 667.159354] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a553ce-6692-41a3-ab44-fe5b38b80d7f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.159969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.159969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.160838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.160949] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.161107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.161184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.161326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.161420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.161519] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a553ce-6692-41a3-ab44-fe5b38b80d7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.421077] env[65087]: INFO networking_nsxv3.common.synchronization [None req-4c565886-f42c-4dc1-b3ba-438e3a1c2241 None None] Enqueued Resource ID: 14b253d9-950f-4fac-9dc6-f9645f11159c with Priority: HIGHEST for action port [ 667.423766] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14b253d9-950f-4fac-9dc6-f9645f11159c with Priority: HIGHEST for action port [ 667.423766] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-14b253d9-950f-4fac-9dc6-f9645f11159c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.423766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14b253d9-950f-4fac-9dc6-f9645f11159c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.423766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14b253d9-950f-4fac-9dc6-f9645f11159c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.423766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14b253d9-950f-4fac-9dc6-f9645f11159c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.423766] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14b253d9-950f-4fac-9dc6-f9645f11159c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.425606] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 667.425606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.426026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.428216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.429436] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.429436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.429436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.429436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.429618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.429618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.429751] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.429880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.429942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.430352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.430427] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.430559] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.430674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.430923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.431065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.431177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.431306] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.491179] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed533055-edc8-45df-94a7-840f2322bfb3 [ 667.491179] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.491179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.491470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.491470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.491533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.493292] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed533055-edc8-45df-94a7-840f2322bfb3 already deleted. [ 667.493292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed533055-edc8-45df-94a7-840f2322bfb3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.664547] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.665754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.665754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.665754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.665754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.665754] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.665754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.665754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.665754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.665754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.666215] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f already deleted. [ 667.666215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.934289] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14b253d9-950f-4fac-9dc6-f9645f11159c [ 667.934521] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.934769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.934769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.935256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.935256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.935256] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14b253d9-950f-4fac-9dc6-f9645f11159c already deleted. [ 667.935256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14b253d9-950f-4fac-9dc6-f9645f11159c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.935418] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0756d72c-9df8-4861-9190-090f401edeb6: rpc.has_security_group_logging(os_id): False [ 667.956155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.956323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.956323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.957728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.978599] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 in Status: SUCCESS [ 667.978832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.003018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.003018] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.003018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.003018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.003018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.003018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.003481] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.003481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.003481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.003481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.003481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.003740] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.003792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.003860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.005085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.005143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.005202] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be updated. [ 668.097546] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.097546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.097546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.097820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.099633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.120548] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: IN_PROGRESS for 2s [ 668.723129] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.723330] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-907" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.723457] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-907" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.723839] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-907" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.724136] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.724294] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.724406] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.724688] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.724773] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.725030] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.725123] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.725213] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.725310] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.725411] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.725693] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.725693] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.748141] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.748562] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.748562] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.748893] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-907" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.749095] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-0b6d5e60-e222-471f-91ac-43cc682db508 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.749366] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-0b6d5e60-e222-471f-91ac-43cc682db508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.749483] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-0b6d5e60-e222-471f-91ac-43cc682db508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.749911] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-0b6d5e60-e222-471f-91ac-43cc682db508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.750071] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6d5e60-e222-471f-91ac-43cc682db508',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.252250] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.253037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.253037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.253037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.253324] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.253324] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 0b6d5e60-e222-471f-91ac-43cc682db508 not found, creating... [ 669.253507] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.253642] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.253787] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.254076] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.254583] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.254659] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.254930] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.254930] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.257976] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.257976] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.257976] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 0b6d5e60-e222-471f-91ac-43cc682db508 is going to be created. [ 669.297128] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.297420] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.297491] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.297783] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.298142] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.298348] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-0b6d5e60-e222-471f-91ac-43cc682db508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.996942] env[65087]: INFO networking_nsxv3.common.synchronization [req-bdc11366-e4e7-414d-b0e4-99b3517e9c01 req-c98a8137-668e-47cd-b30d-0f59f53e70d2 service nova] Enqueued Resource ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f with Priority: HIGHEST for action security_group_rules [ 669.998960] env[65087]: INFO networking_nsxv3.common.synchronization [req-bdc11366-e4e7-414d-b0e4-99b3517e9c01 req-c98a8137-668e-47cd-b30d-0f59f53e70d2 service nova] Enqueued Resource ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f with Priority: HIGHEST for action security_group_members [ 669.998960] env[65087]: INFO networking_nsxv3.common.synchronization [req-bdc11366-e4e7-414d-b0e4-99b3517e9c01 req-c98a8137-668e-47cd-b30d-0f59f53e70d2 service nova] Enqueued Resource ID: 0b6d5e60-e222-471f-91ac-43cc682db508 with Priority: HIGHEST for action port [ 669.998960] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f with Priority: HIGHEST for action security_group_rules [ 669.998960] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f with Priority: HIGHEST for action security_group_members [ 669.998960] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6d5e60-e222-471f-91ac-43cc682db508 with Priority: HIGHEST for action port [ 669.998960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43a553ce-6692-41a3-ab44-fe5b38b80d7f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.999395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.999395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.999395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.999516] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43a553ce-6692-41a3-ab44-fe5b38b80d7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.000962] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a553ce-6692-41a3-ab44-fe5b38b80d7f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.001080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.001137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.001287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.001436] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.001530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.001590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.001731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.001812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.001902] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a553ce-6692-41a3-ab44-fe5b38b80d7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.003849] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b6d5e60-e222-471f-91ac-43cc682db508 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.003849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b6d5e60-e222-471f-91ac-43cc682db508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.003849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b6d5e60-e222-471f-91ac-43cc682db508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.004068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b6d5e60-e222-471f-91ac-43cc682db508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.004068] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6d5e60-e222-471f-91ac-43cc682db508',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.136829] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 670.137649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.137649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.137649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.137649] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.504626] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a553ce-6692-41a3-ab44-fe5b38b80d7f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.505208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.505208] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43a553ce-6692-41a3-ab44-fe5b38b80d7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.505979] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b6d5e60-e222-471f-91ac-43cc682db508 with status ACTIVE [ 670.506197] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.506354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.506436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.506691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.506796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.506993] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.507652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.507652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.507652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.507652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.508447] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.508583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.508650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.508804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.508948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.509056] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b6d5e60-e222-471f-91ac-43cc682db508 is going to be updated. [ 670.532920] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.533107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.533168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.533421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.533564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.533817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b6d5e60-e222-471f-91ac-43cc682db508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.642261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.642523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.642679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.642968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.643191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.643249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.644219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.644219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.644219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.644219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.644219] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.646241] env[65087]: INFO networking_nsxv3.common.synchronization [None req-0a905351-c720-4722-a150-86a9259fc9e1 None None] Enqueued Resource ID: 0bc7841d-be6e-4e46-9132-1b91518ef10b with Priority: HIGHEST for action port [ 670.647930] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bc7841d-be6e-4e46-9132-1b91518ef10b with Priority: HIGHEST for action port [ 670.647930] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bc7841d-be6e-4e46-9132-1b91518ef10b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.648192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bc7841d-be6e-4e46-9132-1b91518ef10b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.648192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bc7841d-be6e-4e46-9132-1b91518ef10b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.648841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bc7841d-be6e-4e46-9132-1b91518ef10b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.648841] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bc7841d-be6e-4e46-9132-1b91518ef10b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.011651] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43a553ce-6692-41a3-ab44-fe5b38b80d7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.050127] env[65087]: INFO networking_nsxv3.common.synchronization [None req-771f99f5-1e3a-4226-a36e-e1e320385d54 None None] Enqueued Resource ID: ea0690b7-8416-4937-ab0f-cc11e62d5a22 with Priority: HIGHEST for action port [ 671.050635] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea0690b7-8416-4937-ab0f-cc11e62d5a22 with Priority: HIGHEST for action port [ 671.051433] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea0690b7-8416-4937-ab0f-cc11e62d5a22 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.051674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea0690b7-8416-4937-ab0f-cc11e62d5a22" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.051796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea0690b7-8416-4937-ab0f-cc11e62d5a22" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.052194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea0690b7-8416-4937-ab0f-cc11e62d5a22" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.052316] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea0690b7-8416-4937-ab0f-cc11e62d5a22',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.148041] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.148970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.148970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.148970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.148970] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.148970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.148970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.149303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.149303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.149303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.149438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.149554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.149624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.149783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.149941] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.150064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.150156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.150316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.150424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.150573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.150684] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.151718] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bc7841d-be6e-4e46-9132-1b91518ef10b [ 671.151878] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.151991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.152081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.152255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.152360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.152431] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bc7841d-be6e-4e46-9132-1b91518ef10b already deleted. [ 671.153107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bc7841d-be6e-4e46-9132-1b91518ef10b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.516101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.516101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.516101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.516101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.516101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.516101] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f is going to be created. [ 671.548644] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.548644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.548644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.548644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.548644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.555116] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea0690b7-8416-4937-ab0f-cc11e62d5a22 [ 671.556332] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.556332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.556332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.557128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.557128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.557128] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea0690b7-8416-4937-ab0f-cc11e62d5a22 already deleted. [ 671.557128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea0690b7-8416-4937-ab0f-cc11e62d5a22" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.558937] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f in Status: UNINITIALIZED for 2s [ 671.654631] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0756d72c-9df8-4861-9190-090f401edeb6: rpc.has_security_group_logging(os_id): False [ 671.677739] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.677925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.677925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.678177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.678274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.678471] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.678572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.678637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.678790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.678869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.679092] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.679228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.679276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.679396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.679472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.679667] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.679763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.679825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.679963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.680278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.680428] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be updated. [ 671.754564] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.754784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.754888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.755212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.755416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.773908] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: IN_PROGRESS for 2s [ 673.572330] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f in Status: SUCCESS [ 673.572610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.572774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.573017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.573213] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.573348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.573415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.573571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.573669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.573775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.573870] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43a553ce-6692-41a3-ab44-fe5b38b80d7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.792267] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 673.792737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.078141] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a553ce-6692-41a3-ab44-fe5b38b80d7f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.079432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.079616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.079873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.080090] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.080193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.080272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.080764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.080764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.080764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.080936] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a553ce-6692-41a3-ab44-fe5b38b80d7f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.080936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.080936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.081124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.081299] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.081414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.081472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.081737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.081737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.081848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.081848] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43a553ce-6692-41a3-ab44-fe5b38b80d7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.283677] env[65087]: INFO networking_nsxv3.common.synchronization [None req-19d3f590-f535-4004-8e96-60458dcbbdc2 None None] Enqueued Resource ID: ca62980e-25e1-4d81-9a6e-0727710ebfad with Priority: HIGHEST for action port [ 674.283677] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca62980e-25e1-4d81-9a6e-0727710ebfad with Priority: HIGHEST for action port [ 674.283957] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca62980e-25e1-4d81-9a6e-0727710ebfad taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.284152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca62980e-25e1-4d81-9a6e-0727710ebfad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.284276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca62980e-25e1-4d81-9a6e-0727710ebfad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.284556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca62980e-25e1-4d81-9a6e-0727710ebfad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.284672] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca62980e-25e1-4d81-9a6e-0727710ebfad',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.588820] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43a553ce-6692-41a3-ab44-fe5b38b80d7f: rpc.has_security_group_logging(os_id): False [ 674.608213] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.608424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.608473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.608815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.608896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.609456] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.609456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.609456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.609456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.610262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.610262] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.610262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.610262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.610262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.610813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.613372] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.613372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.613372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.613372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.613372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.613372] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f is going to be created. [ 674.689934] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.690892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.690892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.690892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.690892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.710284] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f in Status: IN_PROGRESS for 2s [ 674.787047] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca62980e-25e1-4d81-9a6e-0727710ebfad [ 674.787379] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.787450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.787520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.787776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.787846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.788813] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca62980e-25e1-4d81-9a6e-0727710ebfad already deleted. [ 674.788813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca62980e-25e1-4d81-9a6e-0727710ebfad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.316855] env[65087]: INFO networking_nsxv3.common.synchronization [req-22cda5e6-2e7e-43e5-b38a-ada0b83bd5f9 req-33e931bd-bf8e-42df-b73c-c1bc54fe6cb2 tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 675.318809] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 675.319319] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.319500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.319596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.319927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.320182] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.320713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.320854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.321700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.321700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.321700] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.822790] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.823133] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.823133] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.823361] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.823606] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.823759] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.823867] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.824197] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.824370] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.824578] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.824688] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.824785] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.824888] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.824989] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.825099] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.825226] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.826640] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.826756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.826822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.826973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.845781] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.845957] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.846079] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.846253] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.846559] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-d62a9433-5040-4a03-819f-4f303c6987e8 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.846724] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-d62a9433-5040-4a03-819f-4f303c6987e8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.846833] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-d62a9433-5040-4a03-819f-4f303c6987e8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.847188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-d62a9433-5040-4a03-819f-4f303c6987e8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.847321] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d62a9433-5040-4a03-819f-4f303c6987e8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.850694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.850917] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.851157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.851245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.851437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.851521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.851611] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 675.881597] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.881775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.881831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.882091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.882305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.895467] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 676.349690] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.349941] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.350101] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.350426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.350636] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.350729] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port d62a9433-5040-4a03-819f-4f303c6987e8 not found, creating... [ 676.350987] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.351177] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.351302] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.351579] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.351680] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.352012] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.354062] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.354298] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.354646] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.354855] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.355096] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: d62a9433-5040-4a03-819f-4f303c6987e8 is going to be created. [ 676.381052] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.381276] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.381425] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.381674] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.381920] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.382151] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-d62a9433-5040-4a03-819f-4f303c6987e8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.721670] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f in Status: SUCCESS [ 676.721670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.856367] env[65087]: INFO networking_nsxv3.common.synchronization [None req-19749d32-0721-4d1a-9e46-3f05218b2aba None None] Enqueued Resource ID: 934f3eee-446c-460a-9840-6c01d53019ed with Priority: HIGHEST for action port [ 676.857392] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 934f3eee-446c-460a-9840-6c01d53019ed with Priority: HIGHEST for action port [ 676.858529] env[65087]: INFO networking_nsxv3.common.synchronization [None req-e51a5596-b791-4de4-93e6-a73d71323f02 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_rules [ 676.859437] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-934f3eee-446c-460a-9840-6c01d53019ed taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.860085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-934f3eee-446c-460a-9840-6c01d53019ed" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.860085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-934f3eee-446c-460a-9840-6c01d53019ed" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.860085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-934f3eee-446c-460a-9840-6c01d53019ed" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.860085] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('934f3eee-446c-460a-9840-6c01d53019ed',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.861373] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_rules [ 676.864192] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.864192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.864192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.864192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.864192] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.105760] env[65087]: INFO networking_nsxv3.common.synchronization [req-22cda5e6-2e7e-43e5-b38a-ada0b83bd5f9 req-3c43feb7-bd99-46f2-a849-534d8eb158c5 service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 677.105971] env[65087]: INFO networking_nsxv3.common.synchronization [req-22cda5e6-2e7e-43e5-b38a-ada0b83bd5f9 req-3c43feb7-bd99-46f2-a849-534d8eb158c5 service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 677.106135] env[65087]: INFO networking_nsxv3.common.synchronization [req-22cda5e6-2e7e-43e5-b38a-ada0b83bd5f9 req-3c43feb7-bd99-46f2-a849-534d8eb158c5 service nova] Enqueued Resource ID: d62a9433-5040-4a03-819f-4f303c6987e8 with Priority: HIGHEST for action port [ 677.109036] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 677.109036] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 677.109179] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d62a9433-5040-4a03-819f-4f303c6987e8 with Priority: HIGHEST for action port [ 677.109411] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.109536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.109590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.109800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.109888] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.111190] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.111379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.111490] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d62a9433-5040-4a03-819f-4f303c6987e8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.111587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d62a9433-5040-4a03-819f-4f303c6987e8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.111675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d62a9433-5040-4a03-819f-4f303c6987e8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.112042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d62a9433-5040-4a03-819f-4f303c6987e8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.112042] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d62a9433-5040-4a03-819f-4f303c6987e8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.176390] env[65087]: INFO networking_nsxv3.common.synchronization [req-0e76c52d-1416-4600-9eac-44ffa890c2c8 req-ec319f07-c1b1-4cb7-9130-cdbdee69e3de tempest-ServerExternalEventsTest-803866803 tempest-ServerExternalEventsTest-803866803-project-member] Enqueued Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGHEST for action security_group_members [ 677.177356] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGHEST for action security_group_members [ 677.177774] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf51869e-19e4-466b-9282-9b2c63589cff taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.178180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.178256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.178618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.178805] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.178918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.178991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.179150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.179233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.179337] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.287053] env[65087]: INFO networking_nsxv3.common.synchronization [None req-82664a69-bbf6-4677-ab00-31c5a5fa4c5a tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_rules [ 677.287053] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_rules [ 677.287053] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.287053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.362680] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 934f3eee-446c-460a-9840-6c01d53019ed [ 677.362995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.363117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.364502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.364616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.364814] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.364814] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:934f3eee-446c-460a-9840-6c01d53019ed already deleted. [ 677.364951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-934f3eee-446c-460a-9840-6c01d53019ed" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.389644] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.389644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.389644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.389644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.389644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.389644] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f already deleted. [ 677.390095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.390095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.390296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.390470] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.613952] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.614103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.614307] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d62a9433-5040-4a03-819f-4f303c6987e8 with status ACTIVE [ 677.614494] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.614578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.614658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.614904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.614992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.615171] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.615272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.615327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.615494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.615574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.615756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.615853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.615912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.616190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.616275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.616368] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d62a9433-5040-4a03-819f-4f303c6987e8 is going to be updated. [ 677.639125] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.639125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.639125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.639125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.639125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.639125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d62a9433-5040-4a03-819f-4f303c6987e8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.682614] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.682787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.682787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.683047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.725174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.725237] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.725454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.725454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.725715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.725775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.725864] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf51869e-19e4-466b-9282-9b2c63589cff is going to be updated. [ 677.775775] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.776122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.777898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.777898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.777898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.787504] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf51869e-19e4-466b-9282-9b2c63589cff in Status: IN_PROGRESS for 2s [ 677.920815] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 677.921206] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 deletion is rescheduled due to dependency. [ 677.921206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.923026] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.923173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.923220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.923430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.923518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.923626] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f already deleted. [ 677.923718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.923874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.924050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.924510] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.924914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.924990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.925114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.925199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.925295] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.427927] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.929008] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.051965] env[65087]: INFO networking_nsxv3.common.synchronization [req-3b284db8-d88e-46f1-8de6-7aaf42df7943 req-11d18d63-479a-4f0b-944e-04fda6c59a95 tempest-SecurityGroupRulesTestJSON-615434589 tempest-SecurityGroupRulesTestJSON-615434589-project-member] Enqueued Resource ID: c34850ff-0bdf-486d-8a6c-084f62fce961 with Priority: HIGHEST for action security_group_rules [ 679.053326] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c34850ff-0bdf-486d-8a6c-084f62fce961 with Priority: HIGHEST for action security_group_rules [ 679.053326] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c34850ff-0bdf-486d-8a6c-084f62fce961 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.053510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c34850ff-0bdf-486d-8a6c-084f62fce961" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.053602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c34850ff-0bdf-486d-8a6c-084f62fce961" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.053920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c34850ff-0bdf-486d-8a6c-084f62fce961" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.054021] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c34850ff-0bdf-486d-8a6c-084f62fce961',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.432211] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.432549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.432713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.433030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.433164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.433324] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 679.464885] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.465640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.465778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.466040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.466273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.477202] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 679.576345] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.576345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.576345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.576345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.576345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.576345] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c34850ff-0bdf-486d-8a6c-084f62fce961 already deleted. [ 679.577245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c34850ff-0bdf-486d-8a6c-084f62fce961" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.799122] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf51869e-19e4-466b-9282-9b2c63589cff in Status: SUCCESS [ 679.799122] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf51869e-19e4-466b-9282-9b2c63589cff deletion is rescheduled due to dependency. [ 679.799122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.490320] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 681.490647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.490817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.491052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.491248] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.491372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.491438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.491589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.491672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.491765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.491941] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.545054] env[65087]: INFO networking_nsxv3.common.synchronization [req-90451b93-d170-425b-b634-95bb0ec90eee req-40a40a9b-123c-4c6f-bed9-2fbf49c2333d tempest-FloatingIPsAssociationNegativeTestJSON-1168683800 tempest-FloatingIPsAssociationNegativeTestJSON-1168683800-project-member] Enqueued Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGHEST for action security_group_members [ 681.545054] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGHEST for action security_group_members [ 681.545054] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-56b74809-473d-4b46-a128-e8953c39feab taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.545054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.545054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.545054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.545054] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.545054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.545054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.545603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.545603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.545603] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.994981] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.995158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.995868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.995868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.995868] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.995868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.995868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.996201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.996201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.996201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.996348] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.996439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.996497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.996641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.996792] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.996912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.996963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.997119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.997164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.997303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.997339] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.048039] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.048039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.048039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.048039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.070380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.070842] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.071022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.071176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.071290] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.071435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.071515] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56b74809-473d-4b46-a128-e8953c39feab is going to be updated. [ 682.131286] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.131286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.131455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.131611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.131659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.142421] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56b74809-473d-4b46-a128-e8953c39feab in Status: IN_PROGRESS for 2s [ 682.504822] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0af2af-9718-4a7b-876d-92e1124cdbd2: rpc.has_security_group_logging(os_id): False [ 682.522923] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.523092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.523141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.524047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.524047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.524047] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.524047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.524047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.524047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.524396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.524396] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.524396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.524396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.524704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.524704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.524857] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.524979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.525047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.525225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.525291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.525337] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 682.605998] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.605998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.605998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.605998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.605998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.622915] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 683.214199] env[65087]: INFO networking_nsxv3.common.synchronization [req-7b718bdb-49ae-4ed5-bdd5-00712a3fec3d req-7f3ab480-9ccf-4077-8352-70d4be211eb4 tempest-ServerDiagnosticsNegativeTest-1189625242 tempest-ServerDiagnosticsNegativeTest-1189625242-project-member] Enqueued Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGHEST for action security_group_members [ 683.215132] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGHEST for action security_group_members [ 683.215750] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f44c5dff-d003-41a8-874e-8ad81c2de7ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.215934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.216067] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.216361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.216361] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.216721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.216721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.216721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.216945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.216945] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.724835] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.724835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.724835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.725245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.725245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.725500] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.725608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.725727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.726027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.726144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.726262] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca is going to be updated. [ 683.745482] env[65087]: INFO networking_nsxv3.common.synchronization [req-fef46f44-b347-45d7-a65a-0c9f8191314f req-0eb78343-1966-4164-bdba-cccfc8179068 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 683.747605] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 683.747605] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.747850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.747976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.748308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.748502] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.748643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.748714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.748898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.748991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.749142] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.763228] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.763364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.763436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.763656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.763821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.779530] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca in Status: IN_PROGRESS for 2s [ 684.067167] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.067418] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.067592] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.067900] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.068281] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.068468] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.068631] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.069071] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.069264] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.069504] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.069601] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.069754] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.070416] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.070416] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.070416] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.070416] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.091729] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.091982] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.092221] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.092221] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.092544] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-82d67a3c-e502-4515-b4eb-00125e7296a8 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.092834] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-82d67a3c-e502-4515-b4eb-00125e7296a8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.092950] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-82d67a3c-e502-4515-b4eb-00125e7296a8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.093223] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-82d67a3c-e502-4515-b4eb-00125e7296a8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.093398] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82d67a3c-e502-4515-b4eb-00125e7296a8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.154123] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 56b74809-473d-4b46-a128-e8953c39feab in Status: SUCCESS [ 684.154404] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 56b74809-473d-4b46-a128-e8953c39feab deletion is rescheduled due to dependency. [ 684.154494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.251837] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.252080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.252256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.252369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.252461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.252728] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.252872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.252936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.253079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.253137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.253218] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd already deleted. [ 684.253315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.595528] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.595748] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.595867] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.596156] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.596298] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.596459] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 82d67a3c-e502-4515-b4eb-00125e7296a8 not found, creating... [ 684.596719] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.596871] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.596983] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.597204] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.597401] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.597640] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.597782] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.597906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.598118] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.598329] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.598407] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 82d67a3c-e502-4515-b4eb-00125e7296a8 is going to be created. [ 684.626109] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.626350] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.626489] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.626763] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.626987] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.627221] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-82d67a3c-e502-4515-b4eb-00125e7296a8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.641891] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 684.642167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.376913] env[65087]: INFO networking_nsxv3.common.synchronization [req-fef46f44-b347-45d7-a65a-0c9f8191314f req-876df7a0-7b8b-4f2f-a3ac-62cc59dac0f3 service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 685.377228] env[65087]: INFO networking_nsxv3.common.synchronization [req-fef46f44-b347-45d7-a65a-0c9f8191314f req-876df7a0-7b8b-4f2f-a3ac-62cc59dac0f3 service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 685.377228] env[65087]: INFO networking_nsxv3.common.synchronization [req-fef46f44-b347-45d7-a65a-0c9f8191314f req-876df7a0-7b8b-4f2f-a3ac-62cc59dac0f3 service nova] Enqueued Resource ID: 82d67a3c-e502-4515-b4eb-00125e7296a8 with Priority: HIGHEST for action port [ 685.377765] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 685.377905] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 685.378009] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d67a3c-e502-4515-b4eb-00125e7296a8 with Priority: HIGHEST for action port [ 685.378624] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.378727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.378798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.379129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.379239] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.380093] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.380213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.380280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.380452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.380620] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.380725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.380785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.380929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.381031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.381209] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.381890] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-82d67a3c-e502-4515-b4eb-00125e7296a8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.382014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82d67a3c-e502-4515-b4eb-00125e7296a8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.382088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82d67a3c-e502-4515-b4eb-00125e7296a8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.383983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82d67a3c-e502-4515-b4eb-00125e7296a8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.384112] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82d67a3c-e502-4515-b4eb-00125e7296a8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.594028] env[65087]: INFO networking_nsxv3.common.synchronization [req-08ae215c-39f8-4796-9f45-c144f30cf9f3 req-0d73b2fb-8006-49b7-bdaf-1127f27fc725 tempest-FloatingIPsAssociationTestJSON-1186937205 tempest-FloatingIPsAssociationTestJSON-1186937205-project-member] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 685.594450] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 685.594835] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.594995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.594995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.596135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.596135] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.596135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.596135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.596135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.596135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.596135] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.791886] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca in Status: SUCCESS [ 685.791949] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca deletion is rescheduled due to dependency. [ 685.794690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.886326] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.887543] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.887705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.887820] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82d67a3c-e502-4515-b4eb-00125e7296a8 with status ACTIVE [ 685.887990] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.888149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.888196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.888413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.888728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.888728] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.888840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.888840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.888969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.889195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.889458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.889559] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.889623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.890126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.890126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.890126] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82d67a3c-e502-4515-b4eb-00125e7296a8 is going to be updated. [ 685.921662] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.921856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.921856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.922351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.922520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.922792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82d67a3c-e502-4515-b4eb-00125e7296a8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.981132] env[65087]: INFO networking_nsxv3.common.synchronization [req-e27aa64e-2156-49af-9d9c-cd75fd5c2efd req-e47082e6-e96f-47f4-9cb8-85548b39fd8b tempest-ServerRescueTestJSONUnderV235-1181034759 tempest-ServerRescueTestJSONUnderV235-1181034759-project-member] Enqueued Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 685.981829] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0756d72c-9df8-4861-9190-090f401edeb6 with Priority: HIGHEST for action security_group_members [ 685.982260] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0756d72c-9df8-4861-9190-090f401edeb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.982415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.982485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.982755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.982957] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.983971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.983971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.983971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.983971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.983971] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0756d72c-9df8-4861-9190-090f401edeb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.010865] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-103 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.011094] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-103" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.011253] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-103" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.011579] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-103" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.011876] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.012047] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.012173] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.013223] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.013223] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.013223] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.013223] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 686.013223] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 686.013223] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 686.013223] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 686.013598] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 686.013598] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 686.050126] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 686.050582] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 686.050703] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 686.051310] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-103" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.052782] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-7305f5c4-53b9-4149-83f2-61b7a92dad4d taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.052782] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-7305f5c4-53b9-4149-83f2-61b7a92dad4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.052979] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-7305f5c4-53b9-4149-83f2-61b7a92dad4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.053726] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-7305f5c4-53b9-4149-83f2-61b7a92dad4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.054022] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7305f5c4-53b9-4149-83f2-61b7a92dad4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.098962] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.098962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.098962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.099293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.099354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.099544] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.099684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.099799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.099935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.100030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.100118] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 already deleted. [ 686.100213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.393663] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.488055] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.488055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.488055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.488327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.488327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.488460] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.488548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.488636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.488797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.489063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.489063] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 is going to be updated. [ 686.526728] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.526916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.526916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.527127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.527330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.539507] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: IN_PROGRESS for 2s [ 686.559288] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.559445] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.559503] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.559744] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.559894] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.560053] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 7305f5c4-53b9-4149-83f2-61b7a92dad4d not found, creating... [ 686.560387] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.560456] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.560556] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.560763] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.560893] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.561397] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.561397] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.561554] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.561742] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.561860] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.562097] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 7305f5c4-53b9-4149-83f2-61b7a92dad4d is going to be created. [ 686.586584] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.586923] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.587272] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.587606] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.587977] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.588350] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-7305f5c4-53b9-4149-83f2-61b7a92dad4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.897373] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.897542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.897619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.897839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.897936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.898038] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be created. [ 686.926323] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.926566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.926566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.926837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.927029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.957680] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: UNINITIALIZED for 2s [ 687.386660] env[65087]: INFO networking_nsxv3.common.synchronization [req-08ae215c-39f8-4796-9f45-c144f30cf9f3 req-353bf3b8-4310-4530-a60c-fcdb0ef0666d service nova] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_rules [ 687.386884] env[65087]: INFO networking_nsxv3.common.synchronization [req-08ae215c-39f8-4796-9f45-c144f30cf9f3 req-353bf3b8-4310-4530-a60c-fcdb0ef0666d service nova] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 687.387026] env[65087]: INFO networking_nsxv3.common.synchronization [req-08ae215c-39f8-4796-9f45-c144f30cf9f3 req-353bf3b8-4310-4530-a60c-fcdb0ef0666d service nova] Enqueued Resource ID: 7305f5c4-53b9-4149-83f2-61b7a92dad4d with Priority: HIGHEST for action port [ 687.387665] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_rules [ 687.391885] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 687.391885] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7305f5c4-53b9-4149-83f2-61b7a92dad4d with Priority: HIGHEST for action port [ 687.391885] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.391885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.391885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.391885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.391885] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.392823] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.392882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.392991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.393234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.393925] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.393925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.393925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.393925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.393925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.394382] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.395136] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7305f5c4-53b9-4149-83f2-61b7a92dad4d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.395242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7305f5c4-53b9-4149-83f2-61b7a92dad4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.395242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7305f5c4-53b9-4149-83f2-61b7a92dad4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.395510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7305f5c4-53b9-4149-83f2-61b7a92dad4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.395591] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7305f5c4-53b9-4149-83f2-61b7a92dad4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.898681] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.899916] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.900097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.900320] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7305f5c4-53b9-4149-83f2-61b7a92dad4d with status ACTIVE [ 687.900500] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.900608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.900680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.900874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.900964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.901145] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.901240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.901301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.901451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.901543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.901735] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.901830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.901868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.901988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.902075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.902216] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7305f5c4-53b9-4149-83f2-61b7a92dad4d is going to be updated. [ 687.959169] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.959169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.959426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.959468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.959576] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.959751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7305f5c4-53b9-4149-83f2-61b7a92dad4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.404404] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.436092] env[65087]: INFO networking_nsxv3.common.synchronization [req-fdf6edb9-14c3-4b5a-906b-732cf9a3288a req-d8b444bf-35f1-4acb-bd47-ee1edf9a55a3 tempest-InstanceActionsV221TestJSON-1773680007 tempest-InstanceActionsV221TestJSON-1773680007-project-member] Enqueued Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGHEST for action security_group_members [ 688.436904] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGHEST for action security_group_members [ 688.436904] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e16ad16-0de9-45ee-937f-dc86cca17f4d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.437088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.437088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.437334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.437488] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.437591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.437655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.437811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.437932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.437979] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.549937] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0756d72c-9df8-4861-9190-090f401edeb6 in Status: SUCCESS [ 688.549937] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0756d72c-9df8-4861-9190-090f401edeb6 deletion is rescheduled due to dependency. [ 688.549937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0756d72c-9df8-4861-9190-090f401edeb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.575837] env[65087]: INFO networking_nsxv3.common.synchronization [req-884cf58e-5c52-46a1-9d61-c4b29343fe7c req-332128a1-4d85-457a-87dd-3cf477c984c0 tempest-SecurityGroupRulesTestJSON-615434589 tempest-SecurityGroupRulesTestJSON-615434589-project-member] Enqueued Resource ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 with Priority: HIGHEST for action security_group_rules [ 688.575837] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 with Priority: HIGHEST for action security_group_rules [ 688.575837] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.575837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.575837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.576719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.577016] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01aff53f-549c-4355-a9ee-d0ac5b3667e2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.895877] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-882 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.896100] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-882" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.896203] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-882" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.896521] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-882" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.896771] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.896921] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.897122] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.897362] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.897536] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.897851] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.897991] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.898149] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.898263] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.898389] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.898516] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.898732] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.906995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.907215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.907315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.907526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.907645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.907761] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 is going to be created. [ 688.918055] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.918322] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 688.918456] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.918651] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-882" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.919245] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.919325] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.919469] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.919770] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.919921] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0174d0fd-1e9a-4e0e-a19c-f7707f31220e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.932019] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.932217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.932263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.932516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.932735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.939976] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.940270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.940349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.940541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.940709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.941608] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.941608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.941608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.941608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.941608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.941608] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d already deleted. [ 688.941608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.962847] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: UNINITIALIZED for 2s [ 688.962847] env[65087]: INFO networking_nsxv3.common.synchronization [None req-37b4ac27-5ba9-4c32-90d0-c21d91c9cd39 None None] Enqueued Resource ID: e70c40ff-b72e-4073-a040-70d20f391342 with Priority: HIGHEST for action port [ 688.962847] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e70c40ff-b72e-4073-a040-70d20f391342 with Priority: HIGHEST for action port [ 688.962847] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e70c40ff-b72e-4073-a040-70d20f391342 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.962847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e70c40ff-b72e-4073-a040-70d20f391342" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.962847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e70c40ff-b72e-4073-a040-70d20f391342" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.962847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e70c40ff-b72e-4073-a040-70d20f391342" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.962847] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e70c40ff-b72e-4073-a040-70d20f391342',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.967825] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 688.968223] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.968693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.968946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.969195] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.969347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.969437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.969633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.969758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.969870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.970009] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.101560] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.101853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.101972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.102275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.102419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.102571] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 already deleted. [ 689.102760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.423143] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.423416] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.423465] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.423803] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.424040] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.424213] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 0174d0fd-1e9a-4e0e-a19c-f7707f31220e not found, creating... [ 689.424463] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.424615] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.424719] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.424934] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.425078] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.425338] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.425483] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.425589] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.425788] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.425916] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.426058] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 0174d0fd-1e9a-4e0e-a19c-f7707f31220e is going to be created. [ 689.449869] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.450089] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.450228] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.450494] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.450750] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.450981] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.451946] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e70c40ff-b72e-4073-a040-70d20f391342 [ 689.452854] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.452854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.452854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.452854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.452854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.452854] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e70c40ff-b72e-4073-a040-70d20f391342 already deleted. [ 689.452854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e70c40ff-b72e-4073-a040-70d20f391342" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.475139] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.475327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.475400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.475601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.475766] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.475866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.475930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.476093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.476183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.476285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.476408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.476499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.476560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.476697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.476832] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.476919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.476979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.477127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.477203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.477383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.477383] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.748233] env[65087]: INFO networking_nsxv3.common.synchronization [req-94e7712d-52ca-48b3-944e-4f5ad4cd9a43 req-dce85eca-aa48-4c9f-bd12-f1bbde79c1a2 tempest-ImagesOneServerTestJSON-887301792 tempest-ImagesOneServerTestJSON-887301792-project-member] Enqueued Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGHEST for action security_group_members [ 689.748784] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGHEST for action security_group_members [ 689.749222] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-660ead40-fb4f-4eb7-87db-4a7944439f26 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.749398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.749439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.749645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.749804] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.750864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.750864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.750864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.750864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.750864] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.983873] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 078ba4a4-0e86-4b25-838d-1fc110729dbd: rpc.has_security_group_logging(os_id): False [ 690.002529] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.002712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.002811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.003059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.003156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.003386] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.003499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.003563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.003722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.003801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.003997] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.004105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.004167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.004305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.004379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.004576] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.004688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.004751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.004893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.004969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.005211] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be created. [ 690.067579] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.067817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.067892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.068572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.068572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.094269] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 690.205515] env[65087]: INFO networking_nsxv3.common.synchronization [req-fdf6edb9-14c3-4b5a-906b-732cf9a3288a req-b26d4b7b-fd75-4ff1-8ef3-0c1734000354 service nova] Enqueued Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGHEST for action security_group_rules [ 690.205515] env[65087]: INFO networking_nsxv3.common.synchronization [req-fdf6edb9-14c3-4b5a-906b-732cf9a3288a req-b26d4b7b-fd75-4ff1-8ef3-0c1734000354 service nova] Enqueued Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGHEST for action security_group_members [ 690.205515] env[65087]: INFO networking_nsxv3.common.synchronization [req-fdf6edb9-14c3-4b5a-906b-732cf9a3288a req-b26d4b7b-fd75-4ff1-8ef3-0c1734000354 service nova] Enqueued Resource ID: 0174d0fd-1e9a-4e0e-a19c-f7707f31220e with Priority: HIGHEST for action port [ 690.205515] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGHEST for action security_group_rules [ 690.205515] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGHEST for action security_group_members [ 690.205515] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0174d0fd-1e9a-4e0e-a19c-f7707f31220e with Priority: HIGHEST for action port [ 690.207989] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.208148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.208221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.208500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.208588] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.209543] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e16ad16-0de9-45ee-937f-dc86cca17f4d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.209770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.209770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.209888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.210048] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.210136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.210197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.210336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.210418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.211245] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.211321] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.211421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.211486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.211637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.211712] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0174d0fd-1e9a-4e0e-a19c-f7707f31220e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.252920] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.252920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.253090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.255031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.285021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.285462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.285625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.285698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.285917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.286016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.286112] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 is going to be updated. [ 690.337375] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.337666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.337666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.337804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.337952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.349727] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 in Status: IN_PROGRESS for 2s [ 690.656050] env[65087]: INFO networking_nsxv3.common.synchronization [req-e05e962d-2e1e-4cf8-8fe3-3d59bec5ad0b req-aa48a868-3ce3-4e68-aba5-c619b8c74576 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 690.656050] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 690.656050] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.656657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.656867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.657240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.659468] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.659468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.659468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.659468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.659468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.659468] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.714176] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e16ad16-0de9-45ee-937f-dc86cca17f4d taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.714519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.714836] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.716161] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0174d0fd-1e9a-4e0e-a19c-f7707f31220e with status ACTIVE [ 690.716827] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.717062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.717199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.717805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.717920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.718155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.718267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.718332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.718511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.719373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.719689] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.719919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.720123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.722163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.722297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.722394] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0174d0fd-1e9a-4e0e-a19c-f7707f31220e is going to be updated. [ 690.752229] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.752346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.752419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.752667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.752852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.753041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0174d0fd-1e9a-4e0e-a19c-f7707f31220e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.954058] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: SUCCESS [ 690.955958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.956330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.956726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.961105] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.961105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.961105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.961105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.961105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.961105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.961105] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.162355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.162355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.162355] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f already deleted. [ 691.162355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.225609] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.462567] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.462843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.462843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.463088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.463272] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.463411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.463482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.463646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.463733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.464379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.464379] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.464379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.464379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.464379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.464563] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.464563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.464634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.464736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.464819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.464898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.464986] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.530256] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.530523] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.530765] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.531263] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.531640] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.531840] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.531975] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.532246] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.532380] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.532631] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.532802] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.532922] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.533035] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.533139] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.533231] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.533364] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.556403] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.556659] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.556770] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.556916] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.557253] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-65854835-363e-4dd5-9d48-9599d079f0ab taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.557425] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-65854835-363e-4dd5-9d48-9599d079f0ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.557545] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-65854835-363e-4dd5-9d48-9599d079f0ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.557905] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-65854835-363e-4dd5-9d48-9599d079f0ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.558064] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65854835-363e-4dd5-9d48-9599d079f0ab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.727717] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.728959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.729085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.729325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.729378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.729786] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d is going to be created. [ 691.756169] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c646e230-b60d-4c02-9313-f92394372909 None None] Enqueued Resource ID: 8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c with Priority: HIGHEST for action port [ 691.758163] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.758163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.758163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.758163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.758388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.759919] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c with Priority: HIGHEST for action port [ 691.759956] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.760349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.760349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.760349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.760466] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.770599] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d in Status: UNINITIALIZED for 2s [ 691.969062] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8: rpc.has_security_group_logging(os_id): False [ 691.987200] env[65087]: INFO networking_nsxv3.common.synchronization [req-8d644f49-ca82-476f-943d-08530b26a3a3 req-081c2a98-60ea-423a-ac7b-73ec776a44ad tempest-SecurityGroupRulesTestJSON-615434589 tempest-SecurityGroupRulesTestJSON-615434589-project-member] Enqueued Resource ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 with Priority: HIGHEST for action security_group_rules [ 691.987892] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.988074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.988185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.988400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.988585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.988858] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.989067] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.989153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.989331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.989487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.989957] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.990257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.990352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.991262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.991262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.991262] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.991262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.991262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.991262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.991780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.991909] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 is going to be created. [ 691.996019] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 with Priority: HIGHEST for action security_group_rules [ 691.996019] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.996019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.996019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.996019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.996019] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01aff53f-549c-4355-a9ee-d0ac5b3667e2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.063349] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.063349] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.063349] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.063349] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.063349] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.064184] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 65854835-363e-4dd5-9d48-9599d079f0ab not found, creating... [ 692.065876] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.065876] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.066479] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.066915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.066974] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.067669] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.067781] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.068433] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.068829] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.069516] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.069516] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 65854835-363e-4dd5-9d48-9599d079f0ab is going to be created. [ 692.072038] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.073690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.073690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.073690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.074026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.089760] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: IN_PROGRESS for 2s [ 692.097418] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.097614] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.097733] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.098011] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.098250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.098458] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-65854835-363e-4dd5-9d48-9599d079f0ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.117368] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 692.117552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.263245] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c [ 692.263823] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.263823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.263823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.264072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.264072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.264160] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c already deleted. [ 692.264236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b7f56eb-cc20-4bbd-8cbe-0380d7c3625c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.363514] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 in Status: SUCCESS [ 692.363806] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 deletion is rescheduled due to dependency. [ 692.364207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.521529] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.521725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.521816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.522047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.522143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.522240] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 already deleted. [ 692.522324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.797789] env[65087]: INFO networking_nsxv3.common.synchronization [req-e05e962d-2e1e-4cf8-8fe3-3d59bec5ad0b req-950f4076-7963-4ab1-afb2-275c5b19dcf4 service nova] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_rules [ 692.798234] env[65087]: INFO networking_nsxv3.common.synchronization [req-e05e962d-2e1e-4cf8-8fe3-3d59bec5ad0b req-950f4076-7963-4ab1-afb2-275c5b19dcf4 service nova] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 692.798234] env[65087]: INFO networking_nsxv3.common.synchronization [req-e05e962d-2e1e-4cf8-8fe3-3d59bec5ad0b req-950f4076-7963-4ab1-afb2-275c5b19dcf4 service nova] Enqueued Resource ID: 65854835-363e-4dd5-9d48-9599d079f0ab with Priority: HIGHEST for action port [ 692.798964] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_rules [ 692.799862] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 692.800059] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65854835-363e-4dd5-9d48-9599d079f0ab with Priority: HIGHEST for action port [ 692.800499] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.800692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.800801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.801164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.801226] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.802467] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.802650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.802787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.803633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.805288] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.805288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.805288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.805288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.805288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.805288] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.805839] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-65854835-363e-4dd5-9d48-9599d079f0ab taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.805995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65854835-363e-4dd5-9d48-9599d079f0ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.806111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65854835-363e-4dd5-9d48-9599d079f0ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.806358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65854835-363e-4dd5-9d48-9599d079f0ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.806488] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65854835-363e-4dd5-9d48-9599d079f0ab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.302327] env[65087]: INFO networking_nsxv3.common.synchronization [req-bfef0d2a-b19e-4963-a150-8e8aa278d7d5 req-68be915f-ceea-49b1-8a16-6af77081ba16 tempest-ServerAddressesNegativeTestJSON-1768156645 tempest-ServerAddressesNegativeTestJSON-1768156645-project-member] Enqueued Resource ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f with Priority: HIGHEST for action security_group_members [ 693.303879] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f with Priority: HIGHEST for action security_group_members [ 693.303879] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-43a553ce-6692-41a3-ab44-fe5b38b80d7f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.303879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.303879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.304166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.304166] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.304321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.304358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.306457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.306457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.306457] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43a553ce-6692-41a3-ab44-fe5b38b80d7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.310060] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.310194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.310272] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.311123] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65854835-363e-4dd5-9d48-9599d079f0ab with status ACTIVE [ 693.311279] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.311855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.312535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.312535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.312535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.312535] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.314390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.314459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.314689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.315875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.315875] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.315875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.315875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.315875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.315875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.315875] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65854835-363e-4dd5-9d48-9599d079f0ab is going to be updated. [ 693.339283] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.339283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.339283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.339283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.339283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.339283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65854835-363e-4dd5-9d48-9599d079f0ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.783461] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d in Status: SUCCESS [ 693.783693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.783875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.784595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.784595] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.784595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.784595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.784779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.784779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.784831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.784887] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.811139] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.811139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.811139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.811139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.811139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.811139] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.811139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.811139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.811139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.811836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.811836] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f is going to be updated. [ 693.817149] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.845057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.845057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.845057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.845766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.845766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.856398] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f in Status: IN_PROGRESS for 2s [ 694.111750] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: SUCCESS [ 694.111984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.289836] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e16ad16-0de9-45ee-937f-dc86cca17f4d taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.290592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.290592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.290592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.290792] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.290792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.290792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.290960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.291081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.292302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.292302] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e16ad16-0de9-45ee-937f-dc86cca17f4d taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.292302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.292302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.292302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.292302] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.292302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.292302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.292302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.292669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.292669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.292669] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.318978] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.319429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.319429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.319648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.319719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.320576] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be created. [ 694.354413] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.354520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.354520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.356134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.356134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.369038] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: UNINITIALIZED for 2s [ 694.795759] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e16ad16-0de9-45ee-937f-dc86cca17f4d: rpc.has_security_group_logging(os_id): False [ 694.819416] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.819944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.819944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.819944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.820065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.820266] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.820369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.820369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.820665] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.820665] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.820969] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.821096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.821204] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.821363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.821363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.821580] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.821683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.821757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.821932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.822022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.822155] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d is going to be created. [ 694.901285] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.901285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.901285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.901889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.901889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.916646] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d in Status: IN_PROGRESS for 2s [ 695.867472] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f in Status: SUCCESS [ 695.867715] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43a553ce-6692-41a3-ab44-fe5b38b80d7f deletion is rescheduled due to dependency. [ 695.867785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43a553ce-6692-41a3-ab44-fe5b38b80d7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.378807] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: SUCCESS [ 696.379017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.379195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.379481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.379690] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.379808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.379877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.380061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.380155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.380230] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.380323] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.883282] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.931711] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d in Status: SUCCESS [ 696.931919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.993552] env[65087]: INFO networking_nsxv3.common.synchronization [req-77dbf6c5-cf8f-4aec-b385-d77b8c34ced4 req-4e284ca7-2b17-4266-bcbf-6ef809d80f0a tempest-SecurityGroupRulesTestJSON-615434589 tempest-SecurityGroupRulesTestJSON-615434589-project-member] Enqueued Resource ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 with Priority: HIGHEST for action security_group_rules [ 696.994162] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 with Priority: HIGHEST for action security_group_rules [ 696.994465] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.994594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.994665] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.994885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.994941] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01aff53f-549c-4355-a9ee-d0ac5b3667e2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.385776] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d11ae3e7-68e0-48ab-9cf6-d1803117fc1f: rpc.has_security_group_logging(os_id): False [ 697.406587] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.406980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.407117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.407423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.407611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.408588] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.408737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.408862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.409569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.409723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.409878] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be created. [ 697.480731] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.481604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.481604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.481604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.481604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.493534] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: IN_PROGRESS for 2s [ 697.532719] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.533243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.533243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.533385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.533479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.533576] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01aff53f-549c-4355-a9ee-d0ac5b3667e2 already deleted. [ 697.533792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01aff53f-549c-4355-a9ee-d0ac5b3667e2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.334121] env[65087]: INFO networking_nsxv3.common.synchronization [None req-a42a3580-bca0-4d67-8cd6-372c46f59ef3 None None] Enqueued Resource ID: 6ead52e5-7dad-4f88-b220-f42fcc63276a with Priority: HIGHEST for action port [ 699.334121] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ead52e5-7dad-4f88-b220-f42fcc63276a with Priority: HIGHEST for action port [ 699.334426] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ead52e5-7dad-4f88-b220-f42fcc63276a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.334518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ead52e5-7dad-4f88-b220-f42fcc63276a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.334591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ead52e5-7dad-4f88-b220-f42fcc63276a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.334858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ead52e5-7dad-4f88-b220-f42fcc63276a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.334945] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ead52e5-7dad-4f88-b220-f42fcc63276a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.506126] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: SUCCESS [ 699.506358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.837366] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ead52e5-7dad-4f88-b220-f42fcc63276a [ 699.838121] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.838121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.838285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.838526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.838715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.838942] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ead52e5-7dad-4f88-b220-f42fcc63276a already deleted. [ 699.839052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ead52e5-7dad-4f88-b220-f42fcc63276a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.161774] env[65087]: INFO networking_nsxv3.common.synchronization [None req-e4c2357a-4cfb-46f4-b374-229470f91e9a None None] Enqueued Resource ID: f5955f59-5e80-4124-a913-cdb89b747315 with Priority: HIGHEST for action port [ 700.162543] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5955f59-5e80-4124-a913-cdb89b747315 with Priority: HIGHEST for action port [ 700.162969] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5955f59-5e80-4124-a913-cdb89b747315 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.166249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5955f59-5e80-4124-a913-cdb89b747315" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.166327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5955f59-5e80-4124-a913-cdb89b747315" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.166618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5955f59-5e80-4124-a913-cdb89b747315" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.166706] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5955f59-5e80-4124-a913-cdb89b747315',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.672583] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5955f59-5e80-4124-a913-cdb89b747315 [ 700.672854] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.673065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.673119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.673312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.673401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.673494] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5955f59-5e80-4124-a913-cdb89b747315 already deleted. [ 700.673571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5955f59-5e80-4124-a913-cdb89b747315" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.850849] env[65087]: INFO networking_nsxv3.common.synchronization [None req-56dda5f8-718c-426a-a2c7-542452babbb4 None None] Enqueued Resource ID: 0be9e2c2-7950-4e3c-92a8-fb483fafc6fb with Priority: HIGHEST for action port [ 700.850966] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0be9e2c2-7950-4e3c-92a8-fb483fafc6fb with Priority: HIGHEST for action port [ 700.851190] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0be9e2c2-7950-4e3c-92a8-fb483fafc6fb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.851317] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0be9e2c2-7950-4e3c-92a8-fb483fafc6fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.851387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0be9e2c2-7950-4e3c-92a8-fb483fafc6fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.851655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0be9e2c2-7950-4e3c-92a8-fb483fafc6fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.851745] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0be9e2c2-7950-4e3c-92a8-fb483fafc6fb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.191676] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5c1ead7f-07e8-4c99-bbc4-127c1871dec3 None None] Enqueued Resource ID: ba89bbaf-ceb9-478a-8215-897ab45d32df with Priority: HIGHEST for action port [ 701.191676] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba89bbaf-ceb9-478a-8215-897ab45d32df with Priority: HIGHEST for action port [ 701.191676] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba89bbaf-ceb9-478a-8215-897ab45d32df taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.191676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba89bbaf-ceb9-478a-8215-897ab45d32df" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.192525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba89bbaf-ceb9-478a-8215-897ab45d32df" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.192525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba89bbaf-ceb9-478a-8215-897ab45d32df" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.192525] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba89bbaf-ceb9-478a-8215-897ab45d32df',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.354450] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0be9e2c2-7950-4e3c-92a8-fb483fafc6fb [ 701.354813] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.355084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.355375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.355537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.355687] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.355824] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0be9e2c2-7950-4e3c-92a8-fb483fafc6fb already deleted. [ 701.355959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0be9e2c2-7950-4e3c-92a8-fb483fafc6fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.695879] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba89bbaf-ceb9-478a-8215-897ab45d32df [ 701.697780] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.697780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.697780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.697780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.697780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.697780] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba89bbaf-ceb9-478a-8215-897ab45d32df already deleted. [ 701.697780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba89bbaf-ceb9-478a-8215-897ab45d32df" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.056617] env[65087]: INFO networking_nsxv3.common.synchronization [None req-692fe8ee-0aec-4819-a005-54c754c7f2a5 None None] Enqueued Resource ID: 365d10b1-0cf5-4e23-93e8-141d3d15ce26 with Priority: HIGHEST for action port [ 703.057221] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365d10b1-0cf5-4e23-93e8-141d3d15ce26 with Priority: HIGHEST for action port [ 703.057536] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-365d10b1-0cf5-4e23-93e8-141d3d15ce26 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.057667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-365d10b1-0cf5-4e23-93e8-141d3d15ce26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.057747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-365d10b1-0cf5-4e23-93e8-141d3d15ce26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.058337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-365d10b1-0cf5-4e23-93e8-141d3d15ce26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.058868] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('365d10b1-0cf5-4e23-93e8-141d3d15ce26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.566873] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 365d10b1-0cf5-4e23-93e8-141d3d15ce26 [ 703.566873] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.566873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.566873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.566873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.566873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.566873] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:365d10b1-0cf5-4e23-93e8-141d3d15ce26 already deleted. [ 703.566873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-365d10b1-0cf5-4e23-93e8-141d3d15ce26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.987359] env[65087]: INFO networking_nsxv3.common.synchronization [None req-ab3f43e4-5e1e-429f-bcb1-a4f9be47c8ae None None] Enqueued Resource ID: 129bf86b-99f6-4969-922f-b8f9fb9e5ea4 with Priority: HIGHEST for action port [ 703.989281] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 129bf86b-99f6-4969-922f-b8f9fb9e5ea4 with Priority: HIGHEST for action port [ 703.989636] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-129bf86b-99f6-4969-922f-b8f9fb9e5ea4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.989766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-129bf86b-99f6-4969-922f-b8f9fb9e5ea4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.989835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-129bf86b-99f6-4969-922f-b8f9fb9e5ea4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.990136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-129bf86b-99f6-4969-922f-b8f9fb9e5ea4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.990223] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('129bf86b-99f6-4969-922f-b8f9fb9e5ea4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.492631] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 129bf86b-99f6-4969-922f-b8f9fb9e5ea4 [ 704.494467] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.494467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.494467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.494467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.494467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.494467] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:129bf86b-99f6-4969-922f-b8f9fb9e5ea4 already deleted. [ 704.494467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-129bf86b-99f6-4969-922f-b8f9fb9e5ea4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.142646] env[65087]: INFO networking_nsxv3.common.synchronization [None req-ae92db02-b525-4cd2-ab22-76ec84089774 None None] Enqueued Resource ID: 842decc9-d829-4cdc-8e83-8dd695d72cc3 with Priority: HIGHEST for action port [ 706.143694] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 842decc9-d829-4cdc-8e83-8dd695d72cc3 with Priority: HIGHEST for action port [ 706.144672] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-842decc9-d829-4cdc-8e83-8dd695d72cc3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.144672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-842decc9-d829-4cdc-8e83-8dd695d72cc3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.144672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-842decc9-d829-4cdc-8e83-8dd695d72cc3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.144672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-842decc9-d829-4cdc-8e83-8dd695d72cc3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.144672] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842decc9-d829-4cdc-8e83-8dd695d72cc3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.268502] env[65087]: INFO networking_nsxv3.common.synchronization [None req-eafa0f8b-99d2-4178-bc95-d5cbbc8d5f7c None None] Enqueued Resource ID: 3567d0e5-e8c6-4086-b37d-aa72bd31a4fb with Priority: HIGHEST for action port [ 706.270024] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3567d0e5-e8c6-4086-b37d-aa72bd31a4fb with Priority: HIGHEST for action port [ 706.270024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3567d0e5-e8c6-4086-b37d-aa72bd31a4fb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.270246] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3567d0e5-e8c6-4086-b37d-aa72bd31a4fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.270608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3567d0e5-e8c6-4086-b37d-aa72bd31a4fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.272319] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3567d0e5-e8c6-4086-b37d-aa72bd31a4fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.272319] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3567d0e5-e8c6-4086-b37d-aa72bd31a4fb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.545077] env[65087]: INFO networking_nsxv3.common.synchronization [None req-70c1a38a-d91e-4f0f-aca6-482120d2f525 tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 706.547865] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 706.547865] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.547865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.547865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.548090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.548117] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.647489] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 842decc9-d829-4cdc-8e83-8dd695d72cc3 [ 706.647820] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.648096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.648206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.648593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.648824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.648824] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:842decc9-d829-4cdc-8e83-8dd695d72cc3 already deleted. [ 706.648914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-842decc9-d829-4cdc-8e83-8dd695d72cc3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.742158] env[65087]: INFO networking_nsxv3.common.synchronization [req-646ca11e-557e-470f-8a4d-99cef0acdb13 req-0f4f9365-69db-4918-9cd6-66156518dbf1 tempest-MultipleCreateTestJSON-1770125270 tempest-MultipleCreateTestJSON-1770125270-project-member] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 706.742722] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 706.744238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.744238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.744238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.744238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.745331] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.745525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.745525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.745697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.745816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.745877] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.775658] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3567d0e5-e8c6-4086-b37d-aa72bd31a4fb [ 706.775853] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.775992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.776120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.776472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.776472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.776579] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3567d0e5-e8c6-4086-b37d-aa72bd31a4fb already deleted. [ 706.776612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3567d0e5-e8c6-4086-b37d-aa72bd31a4fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.071853] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.072023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.072136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.072295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.072391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.072497] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 already deleted. [ 707.072566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.250255] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.250540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.250540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.250686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.250780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.251162] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.251268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.251332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.251493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.251577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.251662] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a already deleted. [ 707.251772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.419774] env[65087]: INFO networking_nsxv3.common.synchronization [None req-f339f88d-4a51-4a74-9e1e-9ec6a963fb1a None None] Enqueued Resource ID: 2e260c21-d5f2-4c7a-9395-3b3089871951 with Priority: HIGHEST for action port [ 707.421022] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e260c21-d5f2-4c7a-9395-3b3089871951 with Priority: HIGHEST for action port [ 707.421022] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e260c21-d5f2-4c7a-9395-3b3089871951 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.421180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e260c21-d5f2-4c7a-9395-3b3089871951" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.421273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e260c21-d5f2-4c7a-9395-3b3089871951" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.421864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e260c21-d5f2-4c7a-9395-3b3089871951" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.422054] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e260c21-d5f2-4c7a-9395-3b3089871951',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.625199] env[65087]: INFO networking_nsxv3.common.synchronization [None req-6a870ba1-20af-4c1b-8abe-69fa6c68a27c tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 707.626236] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 707.626419] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.627590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.627590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.627848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.628106] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.891313] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-159 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.891504] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.891643] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.892020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.892388] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.892552] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.892665] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.892915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.893099] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.893320] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.893430] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.893531] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.893647] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.893755] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.893896] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.893983] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.918023] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.918023] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.918023] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.918023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.918023] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-fe1730ca-55ac-429b-8162-0104599b92da taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.918023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-fe1730ca-55ac-429b-8162-0104599b92da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.918023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-fe1730ca-55ac-429b-8162-0104599b92da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.918023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-fe1730ca-55ac-429b-8162-0104599b92da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.918023] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1730ca-55ac-429b-8162-0104599b92da',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.924973] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e260c21-d5f2-4c7a-9395-3b3089871951 [ 707.925226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.925327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.925397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.925625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.925710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.925802] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e260c21-d5f2-4c7a-9395-3b3089871951 already deleted. [ 707.925883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e260c21-d5f2-4c7a-9395-3b3089871951" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.153968] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.154188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.154279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.154597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.154691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.154812] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 already deleted. [ 708.155201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.419668] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.419997] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.420046] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.420360] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.420608] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.420763] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port fe1730ca-55ac-429b-8162-0104599b92da not found, creating... [ 708.421081] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.421353] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.421353] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.421568] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.421695] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.421960] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.422235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.422292] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.422473] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.422612] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.422743] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: fe1730ca-55ac-429b-8162-0104599b92da is going to be created. [ 708.447233] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.447429] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.447561] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.447997] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.448062] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.448304] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-fe1730ca-55ac-429b-8162-0104599b92da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.628134] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5a2119f4-8ee1-4621-a9ec-878416519568 None None] Enqueued Resource ID: 54413b91-48dc-4add-b6db-f9f96b36ba79 with Priority: HIGHEST for action port [ 708.628134] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54413b91-48dc-4add-b6db-f9f96b36ba79 with Priority: HIGHEST for action port [ 708.628134] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-54413b91-48dc-4add-b6db-f9f96b36ba79 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.628403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54413b91-48dc-4add-b6db-f9f96b36ba79" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.628403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54413b91-48dc-4add-b6db-f9f96b36ba79" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.628771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54413b91-48dc-4add-b6db-f9f96b36ba79" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.628771] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54413b91-48dc-4add-b6db-f9f96b36ba79',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.953638] env[65087]: INFO networking_nsxv3.common.synchronization [req-646ca11e-557e-470f-8a4d-99cef0acdb13 req-176851d0-3dc7-4ee2-b714-a9c07fd81071 tempest-MultipleCreateTestJSON-1770125270 tempest-MultipleCreateTestJSON-1770125270-project-member] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 708.954227] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 708.954528] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.954650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.954715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.954910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.955188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.955300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.955362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.955514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.955601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.955693] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.131361] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54413b91-48dc-4add-b6db-f9f96b36ba79 [ 709.131631] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.131769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.131840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.132064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.132194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.132277] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54413b91-48dc-4add-b6db-f9f96b36ba79 already deleted. [ 709.132359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54413b91-48dc-4add-b6db-f9f96b36ba79" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.232073] env[65087]: INFO networking_nsxv3.common.synchronization [req-646ca11e-557e-470f-8a4d-99cef0acdb13 req-9ec925e5-9d82-40a7-b5e2-04654d553db0 service nova] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_rules [ 709.232289] env[65087]: INFO networking_nsxv3.common.synchronization [req-646ca11e-557e-470f-8a4d-99cef0acdb13 req-9ec925e5-9d82-40a7-b5e2-04654d553db0 service nova] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 709.232463] env[65087]: INFO networking_nsxv3.common.synchronization [req-646ca11e-557e-470f-8a4d-99cef0acdb13 req-9ec925e5-9d82-40a7-b5e2-04654d553db0 service nova] Enqueued Resource ID: fe1730ca-55ac-429b-8162-0104599b92da with Priority: HIGHEST for action port [ 709.233097] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_rules [ 709.234275] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 709.234393] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe1730ca-55ac-429b-8162-0104599b92da with Priority: HIGHEST for action port [ 709.235863] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.235863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.235863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.236513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.236655] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.238765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.238872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.239123] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe1730ca-55ac-429b-8162-0104599b92da taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.239233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe1730ca-55ac-429b-8162-0104599b92da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.239313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe1730ca-55ac-429b-8162-0104599b92da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.239518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe1730ca-55ac-429b-8162-0104599b92da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.239604] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1730ca-55ac-429b-8162-0104599b92da',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.457987] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.674272] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-159 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.674425] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.676020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.676020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.676020] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.676020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.676020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.676020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.676020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.676020] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.676314] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.676314] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.676314] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.676391] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.676442] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.676559] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.698021] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.698021] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.698021] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.698021] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.698021] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.698021] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.698021] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.698360] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.698360] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b0bc751-4a2d-49e6-b1d7-375766fa2fcb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.747952] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.747952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.747952] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe1730ca-55ac-429b-8162-0104599b92da with status ACTIVE [ 709.748301] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.748576] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.748718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.749094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.749283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.749747] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.750503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.750503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.750503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.750503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.750503] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.750503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.750762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.751016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.751016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.751016] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe1730ca-55ac-429b-8162-0104599b92da is going to be updated. [ 709.777597] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.778698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.778817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.779111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.779305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.779497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe1730ca-55ac-429b-8162-0104599b92da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.961698] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.203888] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.204027] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.204649] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.204649] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.204649] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.204816] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 9b0bc751-4a2d-49e6-b1d7-375766fa2fcb not found, creating... [ 710.205009] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.205178] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.205288] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.205506] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.205645] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.205957] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.206132] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.206291] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.206471] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.206593] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.206994] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 9b0bc751-4a2d-49e6-b1d7-375766fa2fcb is going to be created. [ 710.231416] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.233441] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.233441] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.233441] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.233441] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.233441] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.464559] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.464879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.464879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.465034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.465130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.465234] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be created. [ 710.493369] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.493616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.493711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.493951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.494123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.504556] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: UNINITIALIZED for 2s [ 710.958225] env[65087]: INFO networking_nsxv3.common.synchronization [req-646ca11e-557e-470f-8a4d-99cef0acdb13 req-f2196cff-7d52-4e45-83da-6d2fe58406c3 service nova] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_rules [ 710.958870] env[65087]: INFO networking_nsxv3.common.synchronization [req-646ca11e-557e-470f-8a4d-99cef0acdb13 req-f2196cff-7d52-4e45-83da-6d2fe58406c3 service nova] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 710.958870] env[65087]: INFO networking_nsxv3.common.synchronization [req-646ca11e-557e-470f-8a4d-99cef0acdb13 req-f2196cff-7d52-4e45-83da-6d2fe58406c3 service nova] Enqueued Resource ID: 9b0bc751-4a2d-49e6-b1d7-375766fa2fcb with Priority: HIGHEST for action port [ 710.959315] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_rules [ 710.959465] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 710.959565] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b0bc751-4a2d-49e6-b1d7-375766fa2fcb with Priority: HIGHEST for action port [ 710.959893] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.960083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.960326] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.960438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.960643] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.960749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.960823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.961090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.961176] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b0bc751-4a2d-49e6-b1d7-375766fa2fcb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.463976] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b0bc751-4a2d-49e6-b1d7-375766fa2fcb with status ACTIVE [ 711.464371] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.464557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.464632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.465899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.465899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.465899] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.465899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.465899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.465899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.465899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.465899] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.465899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.465899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.466195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.466195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.466195] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b0bc751-4a2d-49e6-b1d7-375766fa2fcb is going to be updated. [ 711.488827] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.488978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.489067] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.489337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.489490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.489677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b0bc751-4a2d-49e6-b1d7-375766fa2fcb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.026243] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5bf47fe5-95ee-4e37-8240-307d9cd2a082 None None] Enqueued Resource ID: 5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d with Priority: HIGHEST for action port [ 712.027735] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d with Priority: HIGHEST for action port [ 712.027735] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.027735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.028176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.028176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.028366] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.515982] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 712.517571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.517571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.517571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.517571] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.517571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.517571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.517571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.518202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.518202] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.533595] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d [ 712.535164] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.535313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.535381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.535600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.535680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.535781] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d already deleted. [ 712.535856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bfba1fe-5a6d-4d67-b1cc-ad618a3eb99d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.868653] env[65087]: INFO networking_nsxv3.common.synchronization [req-782c0002-e686-43cf-920c-b6285fbb5b34 req-c3b5d540-1b5d-4905-bb46-f1d80e9aa4fd tempest-InstanceActionsV221TestJSON-1773680007 tempest-InstanceActionsV221TestJSON-1773680007-project-member] Enqueued Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGHEST for action security_group_members [ 712.869298] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGHEST for action security_group_members [ 712.869624] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e16ad16-0de9-45ee-937f-dc86cca17f4d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.869771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.869858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.870164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.871205] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.871205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.871205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.871205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.871205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.871205] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.022449] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.029950] env[65087]: INFO networking_nsxv3.common.synchronization [None req-730263b2-fcee-418a-ba54-727abb42c978 None None] Enqueued Resource ID: ec3cd48c-8908-4a9a-bd6d-b783326a4a54 with Priority: HIGHEST for action port [ 713.030951] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec3cd48c-8908-4a9a-bd6d-b783326a4a54 with Priority: HIGHEST for action port [ 713.031074] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec3cd48c-8908-4a9a-bd6d-b783326a4a54 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.031904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec3cd48c-8908-4a9a-bd6d-b783326a4a54" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.031996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec3cd48c-8908-4a9a-bd6d-b783326a4a54" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.032296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec3cd48c-8908-4a9a-bd6d-b783326a4a54" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.033201] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec3cd48c-8908-4a9a-bd6d-b783326a4a54',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.376252] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.376252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.376252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.376252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.376252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.376252] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.376252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.376252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.376252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.376252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.376627] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d is going to be updated. [ 713.426746] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.426746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.426746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.426746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.427028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.437848] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d in Status: IN_PROGRESS for 2s [ 713.524623] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.538817] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec3cd48c-8908-4a9a-bd6d-b783326a4a54 [ 713.538817] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.538817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.538817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.538817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.538817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.538817] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec3cd48c-8908-4a9a-bd6d-b783326a4a54 already deleted. [ 713.538817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec3cd48c-8908-4a9a-bd6d-b783326a4a54" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.778177] env[65087]: INFO networking_nsxv3.common.synchronization [req-25a0b723-8f7d-4652-ad91-18a71080233e req-376a0af3-8ab7-4333-820c-17c745f7af1f tempest-SecurityGroupRulesNegativeTestJSON-1781829073 tempest-SecurityGroupRulesNegativeTestJSON-1781829073-project-member] Enqueued Resource ID: 597d345a-7e9b-42ae-922d-3ad9d272a7f7 with Priority: HIGHEST for action security_group_rules [ 713.778748] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597d345a-7e9b-42ae-922d-3ad9d272a7f7 with Priority: HIGHEST for action security_group_rules [ 713.779705] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.779705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.779705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.779972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.779972] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('597d345a-7e9b-42ae-922d-3ad9d272a7f7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.874580] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c54cb9eb-705e-40ac-85b4-d83306361b58 None None] Enqueued Resource ID: 1481bfd8-43b4-4c48-90f4-3a201ca1e581 with Priority: HIGHEST for action port [ 713.875329] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1481bfd8-43b4-4c48-90f4-3a201ca1e581 with Priority: HIGHEST for action port [ 713.875531] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-1481bfd8-43b4-4c48-90f4-3a201ca1e581 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.875674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1481bfd8-43b4-4c48-90f4-3a201ca1e581" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.875747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1481bfd8-43b4-4c48-90f4-3a201ca1e581" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.876018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1481bfd8-43b4-4c48-90f4-3a201ca1e581" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.876120] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1481bfd8-43b4-4c48-90f4-3a201ca1e581',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.032631] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.032631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.032631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.033386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.033501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.033610] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 714.062385] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.062692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.062784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.063064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.063234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.074214] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 714.302706] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.302906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.303043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.303308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.303417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.303510] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 597d345a-7e9b-42ae-922d-3ad9d272a7f7 already deleted. [ 714.303610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.382764] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1481bfd8-43b4-4c48-90f4-3a201ca1e581 [ 714.384155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.384309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.384381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.384588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.384682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.384775] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1481bfd8-43b4-4c48-90f4-3a201ca1e581 already deleted. [ 714.384858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1481bfd8-43b4-4c48-90f4-3a201ca1e581" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.941588] env[65087]: INFO networking_nsxv3.common.synchronization [req-e4cacf73-68ee-4f20-a30c-dcb6b94474a7 req-d76b6d1f-e0db-4d01-840b-592057238e0f tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 714.942732] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 714.942732] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.942884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.942884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.943714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.943714] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.943714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.943714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.943714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.943714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.943946] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.046396] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c84e905e-7b5c-453e-9e60-cb12c9c8acbb None None] Enqueued Resource ID: bde6f28f-eff2-480e-9d82-1bcfb45444c4 with Priority: HIGHEST for action port [ 715.046396] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde6f28f-eff2-480e-9d82-1bcfb45444c4 with Priority: HIGHEST for action port [ 715.046800] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-bde6f28f-eff2-480e-9d82-1bcfb45444c4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.046915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bde6f28f-eff2-480e-9d82-1bcfb45444c4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.046989] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bde6f28f-eff2-480e-9d82-1bcfb45444c4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.047257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bde6f28f-eff2-480e-9d82-1bcfb45444c4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.047334] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bde6f28f-eff2-480e-9d82-1bcfb45444c4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.412024] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-488 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.412024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-488" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.412024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-488" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.412024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-488" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.412024] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.412024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.412024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.412024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.412024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.412024] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.412024] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.412024] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.412024] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.412755] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.412755] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.412755] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.437953] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.437953] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.437953] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.437953] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-488" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.438405] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.438405] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.438814] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.440298] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.440475] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.446379] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.451238] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d in Status: SUCCESS [ 715.451238] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d deletion is rescheduled due to dependency. [ 715.451238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.551694] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bde6f28f-eff2-480e-9d82-1bcfb45444c4 [ 715.551982] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.552277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.556051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.556051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.556051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.556051] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bde6f28f-eff2-480e-9d82-1bcfb45444c4 already deleted. [ 715.556051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bde6f28f-eff2-480e-9d82-1bcfb45444c4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.868114] env[65087]: INFO networking_nsxv3.common.synchronization [None req-cbc3f8b9-615b-4235-aa8e-0bb7966ab98b tempest-MigrationsAdminTest-836415837 tempest-MigrationsAdminTest-836415837-project-member] Enqueued Resource ID: f2bc15dc-2cad-4518-a306-3cf3c251c332 with Priority: HIGHEST for action security_group_rules [ 715.868114] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2bc15dc-2cad-4518-a306-3cf3c251c332 with Priority: HIGHEST for action security_group_rules [ 715.868114] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2bc15dc-2cad-4518-a306-3cf3c251c332 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.869117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2bc15dc-2cad-4518-a306-3cf3c251c332" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.869117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2bc15dc-2cad-4518-a306-3cf3c251c332" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.869314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2bc15dc-2cad-4518-a306-3cf3c251c332" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.869442] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2bc15dc-2cad-4518-a306-3cf3c251c332',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.947694] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.947694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.947694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.947694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.947694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.947694] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 not found, creating... [ 715.947694] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.947694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.947694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.947694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.947694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.948570] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.948570] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.948570] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.948570] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.948570] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.950708] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 is going to be created. [ 715.957016] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.988198] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.988616] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.989095] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.989275] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.989639] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.989943] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.075633] env[65087]: INFO networking_nsxv3.common.synchronization [None req-bb42eca4-c627-4368-a8a1-db88206ec234 tempest-MigrationsAdminTest-836415837 tempest-MigrationsAdminTest-836415837-project-member] Enqueued Resource ID: f2bc15dc-2cad-4518-a306-3cf3c251c332 with Priority: HIGHEST for action security_group_rules [ 716.077231] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2bc15dc-2cad-4518-a306-3cf3c251c332 with Priority: HIGHEST for action security_group_rules [ 716.077591] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2bc15dc-2cad-4518-a306-3cf3c251c332 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.077710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2bc15dc-2cad-4518-a306-3cf3c251c332" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.087507] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 716.087804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.087936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.088202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.088450] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.088654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.088766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.089038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.089363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.089490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.089599] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.090672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.092041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.092041] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.092041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.092041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.092041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.092296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.092296] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.391550] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.391694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.391772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.391990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.392102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.392210] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2bc15dc-2cad-4518-a306-3cf3c251c332 already deleted. [ 716.392294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2bc15dc-2cad-4518-a306-3cf3c251c332" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.392443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2bc15dc-2cad-4518-a306-3cf3c251c332" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.392589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2bc15dc-2cad-4518-a306-3cf3c251c332" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.392675] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2bc15dc-2cad-4518-a306-3cf3c251c332',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.460806] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.461018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.461096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.461309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.461394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.461486] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 716.496354] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.496509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.496585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.496791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.496940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.509248] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 716.596172] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.596423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.596907] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.686213] env[65087]: INFO networking_nsxv3.common.synchronization [req-e4cacf73-68ee-4f20-a30c-dcb6b94474a7 req-d1e3a997-3adc-4fc3-a164-b777c58d7de4 service nova] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 716.686213] env[65087]: INFO networking_nsxv3.common.synchronization [req-e4cacf73-68ee-4f20-a30c-dcb6b94474a7 req-d1e3a997-3adc-4fc3-a164-b777c58d7de4 service nova] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 716.686302] env[65087]: INFO networking_nsxv3.common.synchronization [req-e4cacf73-68ee-4f20-a30c-dcb6b94474a7 req-d1e3a997-3adc-4fc3-a164-b777c58d7de4 service nova] Enqueued Resource ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with Priority: HIGHEST for action port [ 716.686491] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 716.686617] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 716.686734] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with Priority: HIGHEST for action port [ 716.687329] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.687440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.687501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.687720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.687794] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.691284] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.691284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.691450] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.691450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.691450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.695024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.695024] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.916513] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.916513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.916666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.917017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.917017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.917129] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2bc15dc-2cad-4518-a306-3cf3c251c332 already deleted. [ 716.917219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2bc15dc-2cad-4518-a306-3cf3c251c332" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.102182] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.193980] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.193980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.195950] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with status ACTIVE [ 717.196501] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.196501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.196641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.197149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.197268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.197633] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.197728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.197728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.198471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.198471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.198471] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.198471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.198663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.198744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.199157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.199157] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 is going to be updated. [ 717.230683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.231044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.231433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.231487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.231661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.231863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.274807] env[65087]: INFO networking_nsxv3.common.synchronization [req-764fb59b-37d3-4dd6-91d2-6c22f3f069de req-719d8400-d896-4a3d-ac83-cb0bcf02e1ea tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 717.275375] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 717.275769] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.276049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.276128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.276710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.276710] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.276710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.276935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.277024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.277168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.277310] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.605700] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.605955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.605955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.606283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.606283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.606371] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 717.645641] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.645870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.645870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.646140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.646467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.659030] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 717.698666] env[65087]: INFO networking_nsxv3.common.synchronization [req-f5c28202-7a30-447d-b53a-b3381e7981c8 req-9c806549-ae2a-48d2-adb8-05af487e1586 tempest-ServersAdminTestJSON-1882897549 tempest-ServersAdminTestJSON-1882897549-project-member] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 717.698666] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 717.698805] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.698918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.698992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.703190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.703367] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.703467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.703538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.703714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.703807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.703908] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.780192] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.780391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.780442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.780626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.780716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.781072] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.781072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.781072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.781231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.781299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.781387] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 717.814226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.814419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.814466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.814682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.814809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.826515] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 717.857565] env[65087]: INFO networking_nsxv3.common.synchronization [req-417bd50d-94f7-43bd-8341-381b1945d5a7 req-9c86b157-aa15-4a48-84a1-c55c13e2e150 tempest-SecurityGroupRulesNegativeTestJSON-1781829073 tempest-SecurityGroupRulesNegativeTestJSON-1781829073-project-member] Enqueued Resource ID: 597d345a-7e9b-42ae-922d-3ad9d272a7f7 with Priority: HIGHEST for action security_group_rules [ 717.858195] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 597d345a-7e9b-42ae-922d-3ad9d272a7f7 with Priority: HIGHEST for action security_group_rules [ 717.858405] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.858529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.858586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.858785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.858866] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('597d345a-7e9b-42ae-922d-3ad9d272a7f7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.130027] env[65087]: INFO networking_nsxv3.common.synchronization [req-cb784ddf-a48f-453f-b7a8-9770bc798c86 req-4bbf3342-ba2e-437f-95b6-a54e7bbc5144 tempest-ServersTestFqdnHostnames-2087557967 tempest-ServersTestFqdnHostnames-2087557967-project-member] Enqueued Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_members [ 718.130027] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGHEST for action security_group_members [ 718.130027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e065c34d-9c70-483b-a4fb-2d44a853cbeb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.130027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.130027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.130027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.130027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.130027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.130730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.130730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.130730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.130730] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.210337] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.210491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.210584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.210807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.211072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.211302] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.211760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.211760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.211760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.211760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.211922] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f already deleted. [ 718.211922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.383680] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.383894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.384018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.384314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.384448] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.384587] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 597d345a-7e9b-42ae-922d-3ad9d272a7f7 already deleted. [ 718.384709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-597d345a-7e9b-42ae-922d-3ad9d272a7f7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.523466] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 718.523682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.523919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.524123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.524313] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.524434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.524502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.524663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.524748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.524933] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.633966] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.634213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.634274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.634484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.659479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.659479] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.659479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.659479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.660170] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.660170] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.660170] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb is going to be updated. [ 718.690864] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.691188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.691283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.691501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.691651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.701099] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb in Status: IN_PROGRESS for 2s [ 718.710496] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.710806] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.711018] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.711411] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.711902] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.712075] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.712241] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.712560] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.712764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.713058] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.713181] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.713312] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.713380] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.713486] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.713591] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.713717] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.734275] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.734460] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.734590] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.734786] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.735135] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.735360] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.735397] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.735723] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.735857] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05ed972a-bb77-4dc9-94d5-58b7a7bcb528',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.027685] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.238646] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.239080] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.239142] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.239525] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.239610] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.239722] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 05ed972a-bb77-4dc9-94d5-58b7a7bcb528 not found, creating... [ 719.239985] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.240163] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.240285] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.240802] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.240802] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.241238] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.241471] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.241660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.241898] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.242074] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.242269] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 05ed972a-bb77-4dc9-94d5-58b7a7bcb528 is going to be created. [ 719.265462] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.265672] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.265788] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.266904] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.266904] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.266904] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.533034] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.671654] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 719.671920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.672538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.672829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.673090] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.673257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.673322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.673544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.673621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.673711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.673924] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.674072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.674157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.674297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.674419] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.674517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.674671] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.674718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.674776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.674852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.674944] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.837799] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 719.838072] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd deletion is rescheduled due to dependency. [ 719.838211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.005572] env[65087]: INFO networking_nsxv3.common.synchronization [req-f5c28202-7a30-447d-b53a-b3381e7981c8 req-df70add6-b15a-41fe-97db-dda7caa9c26e service nova] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_rules [ 720.006369] env[65087]: INFO networking_nsxv3.common.synchronization [req-f5c28202-7a30-447d-b53a-b3381e7981c8 req-df70add6-b15a-41fe-97db-dda7caa9c26e service nova] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 720.006369] env[65087]: INFO networking_nsxv3.common.synchronization [req-f5c28202-7a30-447d-b53a-b3381e7981c8 req-df70add6-b15a-41fe-97db-dda7caa9c26e service nova] Enqueued Resource ID: 05ed972a-bb77-4dc9-94d5-58b7a7bcb528 with Priority: HIGHEST for action port [ 720.006553] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_rules [ 720.006673] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 720.006723] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ed972a-bb77-4dc9-94d5-58b7a7bcb528 with Priority: HIGHEST for action port [ 720.007029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.007152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.007218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.007782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.007782] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.008479] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.008615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.008672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.008919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.009058] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.009141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.010063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.010063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.010063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.010063] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.011038] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.011038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.011038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.011167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.011329] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05ed972a-bb77-4dc9-94d5-58b7a7bcb528',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.033525] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.033672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.033737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.034545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.034679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.034798] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 720.068442] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.068635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.068635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.068922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.069119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.082046] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 720.177512] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e38df862-3877-4fbb-b2b8-8702550f272a: rpc.has_security_group_logging(os_id): False [ 720.202316] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.203936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.203936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.203936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.203936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.203936] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.204376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.204376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.204473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.204517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.206224] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.206224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.206224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.206224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.206224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.206224] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.206224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.206224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.206224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.206840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.206840] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be created. [ 720.307064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.307064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.307064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.307536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.307536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.320109] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 720.513411] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.513592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.513767] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.514753] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05ed972a-bb77-4dc9-94d5-58b7a7bcb528 with status ACTIVE [ 720.516057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.516057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.516057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.516057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.516057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.516057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.516057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.516057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.516057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.516057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.517510] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.517639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.517709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.517880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.517964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.518340] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05ed972a-bb77-4dc9-94d5-58b7a7bcb528 is going to be updated. [ 720.542880] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.543124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.543124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.543424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.543497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.543907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05ed972a-bb77-4dc9-94d5-58b7a7bcb528" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.694113] env[65087]: INFO networking_nsxv3.common.synchronization [req-52532e8a-b77b-4d4b-bc25-58d76e25ae38 req-3497595a-5933-451e-b101-7d3ea48b90c6 tempest-ServerRescueNegativeTestJSON-853652026 tempest-ServerRescueNegativeTestJSON-853652026-project-member] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 720.695366] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 720.695366] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.695366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.695366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.695596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.695703] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.695781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.695869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.695997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.696073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.696172] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.713041] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb in Status: SUCCESS [ 720.713337] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb deletion is rescheduled due to dependency. [ 720.713460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.021462] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.170263] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.170468] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.170578] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.170914] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.171261] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.171431] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.171535] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.171757] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.171899] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.172117] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.172229] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.172335] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.172422] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.172526] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.172622] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.172747] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.194363] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.194624] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.194733] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.194920] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.195249] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-89633399-6ccb-40ac-808a-d668969192a0 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.195426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-89633399-6ccb-40ac-808a-d668969192a0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.195554] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-89633399-6ccb-40ac-808a-d668969192a0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.195884] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-89633399-6ccb-40ac-808a-d668969192a0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.196039] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89633399-6ccb-40ac-808a-d668969192a0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.198674] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.198800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.198939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.199102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.199239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.199364] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.199477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.199586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.199714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.199784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.199838] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 already deleted. [ 721.199947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.523930] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.524419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.524419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.524419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.524560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.524675] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be created. [ 721.551690] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.551690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.551690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.551993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.552216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.563291] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: UNINITIALIZED for 2s [ 721.699047] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.699287] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.699410] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.699827] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.699967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.700151] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 89633399-6ccb-40ac-808a-d668969192a0 not found, creating... [ 721.700465] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.700642] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.700757] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.701120] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.701250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.701528] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.701678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.701921] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.702252] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.702384] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.702520] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 89633399-6ccb-40ac-808a-d668969192a0 is going to be created. [ 721.724905] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.725135] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.725258] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.725523] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.725738] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.725950] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-89633399-6ccb-40ac-808a-d668969192a0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.094808] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 722.095079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.095263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.095507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.095726] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.095859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.095935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.096141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.096253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.096341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.097082] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.334856] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 722.335044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.335044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.335506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.335540] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.381822] env[65087]: INFO networking_nsxv3.common.synchronization [req-a221e588-135d-4a7a-8749-114df6d3af4b req-b5798033-9158-4453-aea3-19c9ebee5332 tempest-ServersTestJSON-1091804776 tempest-ServersTestJSON-1091804776-project-member] Enqueued Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_members [ 722.382481] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGHEST for action security_group_members [ 722.382816] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.383383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.383485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.383692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.383878] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.383991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.384068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.384229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.384322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.384418] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.443973] env[65087]: INFO networking_nsxv3.common.synchronization [req-52532e8a-b77b-4d4b-bc25-58d76e25ae38 req-d867cf79-3a4b-4454-a9b4-8965c519808a service nova] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_rules [ 722.443973] env[65087]: INFO networking_nsxv3.common.synchronization [req-52532e8a-b77b-4d4b-bc25-58d76e25ae38 req-d867cf79-3a4b-4454-a9b4-8965c519808a service nova] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 722.443973] env[65087]: INFO networking_nsxv3.common.synchronization [req-52532e8a-b77b-4d4b-bc25-58d76e25ae38 req-d867cf79-3a4b-4454-a9b4-8965c519808a service nova] Enqueued Resource ID: 89633399-6ccb-40ac-808a-d668969192a0 with Priority: HIGHEST for action port [ 722.443973] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_rules [ 722.443973] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 722.444207] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89633399-6ccb-40ac-808a-d668969192a0 with Priority: HIGHEST for action port [ 722.444533] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.444686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.444777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.445070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.447299] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.447299] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.447299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.447299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.447299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.447299] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.447299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.447299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.447299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.447299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.447299] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.449438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-89633399-6ccb-40ac-808a-d668969192a0 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.449607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89633399-6ccb-40ac-808a-d668969192a0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.449703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89633399-6ccb-40ac-808a-d668969192a0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.450603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89633399-6ccb-40ac-808a-d668969192a0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.450603] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89633399-6ccb-40ac-808a-d668969192a0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.600151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.600151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.600151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.600151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.600151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.600931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.600931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.600931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.600931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.600931] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.841207] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.841207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.841207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.841207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.841207] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.841207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.841207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.841207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.841207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.841207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.841207] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.891730] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.891730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.891730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.891730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.891730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.891730] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.891730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.891730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.891730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.891730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.891730] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 is going to be updated. [ 722.929465] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.929465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.929465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.929465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.930261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.945258] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 in Status: IN_PROGRESS for 2s [ 722.953149] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.953149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.953334] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.957357] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89633399-6ccb-40ac-808a-d668969192a0 with status ACTIVE [ 722.957357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.957357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.957357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.957357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.957992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.957992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.957992] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89633399-6ccb-40ac-808a-d668969192a0 is going to be updated. [ 722.984939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.985173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.985239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.985560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.985747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.985938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89633399-6ccb-40ac-808a-d668969192a0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.103329] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3c0a5a-197c-4c4c-a82b-9342302fe922: rpc.has_security_group_logging(os_id): False [ 723.124627] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.124787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.124882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.126709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.155926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.156176] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.158847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.158847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.158847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.158847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.158847] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.159215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.159215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.159215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.159215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.159806] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.159806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.159806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.159806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.159806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.160166] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 723.250662] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.251232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.251232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.251232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.251359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.267933] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 723.343805] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.343805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.344226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.344263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.344515] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.344778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.344883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.345675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.345846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.346031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.346280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.346465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.346681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.346940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.347549] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.347726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.347831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.348090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.348231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.348351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.348445] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.460340] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.574804] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 723.575078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.575719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.576039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.576275] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.576441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.576558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.577103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.577286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.577414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.577557] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.852326] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e38df862-3877-4fbb-b2b8-8702550f272a: rpc.has_security_group_logging(os_id): False [ 723.877076] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.877076] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.877076] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.877076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.879288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.879288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.883197] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.883348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.883418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.884172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.884172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.884172] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 723.948391] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.948391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.948391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.948391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.948391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.963260] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 723.963625] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.963756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.963824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.964109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.964242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.965749] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be created. [ 724.014155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.014366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.014447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.014738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.014818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.026125] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: UNINITIALIZED for 2s [ 724.080230] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.080432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.080475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.080667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.080828] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.080935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.081014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.083263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.083374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.083461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.083635] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.083740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.083791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.083953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.084113] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.084209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.084267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.084406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.084490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.084573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.084665] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.478950] env[65087]: INFO networking_nsxv3.common.synchronization [None req-16d3c4ee-ce02-4be7-bfe4-beebdf1879c2 None None] Enqueued Resource ID: b2e0194e-ff0d-44b4-aabe-aa1b20606989 with Priority: HIGHEST for action port [ 724.479873] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e0194e-ff0d-44b4-aabe-aa1b20606989 with Priority: HIGHEST for action port [ 724.480655] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2e0194e-ff0d-44b4-aabe-aa1b20606989 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.480849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2e0194e-ff0d-44b4-aabe-aa1b20606989" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.480985] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2e0194e-ff0d-44b4-aabe-aa1b20606989" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.481429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2e0194e-ff0d-44b4-aabe-aa1b20606989" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.481577] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2e0194e-ff0d-44b4-aabe-aa1b20606989',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.588870] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f: rpc.has_security_group_logging(os_id): False [ 724.600409] env[65087]: INFO networking_nsxv3.common.synchronization [req-fbb31388-ba09-437c-b452-24d7e7a40c7d req-d4eabbc5-1a3e-48f8-b25a-03406abdafa6 tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 724.601648] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 724.601648] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.601648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.601648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.601648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.601880] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.601880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.602085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.602123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.602176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.602282] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.610637] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.610816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.611192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.611192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.611192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.611437] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.611496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.611534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.611668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.611748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.611934] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.612043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.612108] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.612252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.612329] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.612574] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.613028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.613364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.613528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.613612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.613703] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be created. [ 724.675501] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.675722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.675722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.675984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.676117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.686412] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 724.959205] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 in Status: SUCCESS [ 724.959500] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 deletion is rescheduled due to dependency. [ 724.959500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.984087] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2e0194e-ff0d-44b4-aabe-aa1b20606989 [ 724.985256] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.985256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.985256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.985256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.985256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.985256] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2e0194e-ff0d-44b4-aabe-aa1b20606989 already deleted. [ 724.985256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2e0194e-ff0d-44b4-aabe-aa1b20606989" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.104391] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.104573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.104638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.105980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.105980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.105980] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.105980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.105980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.105980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.105980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.105980] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 725.139130] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.139130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.139130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.139130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.139130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.152363] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 725.287390] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 725.287619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.387366] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7205d17-7b81-48a3-b94f-048f8c946e4a req-9500b572-60a5-4205-9a1f-f5a442b30db2 tempest-FloatingIPsAssociationTestJSON-1186937205 tempest-FloatingIPsAssociationTestJSON-1186937205-project-member] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 725.387366] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 725.388490] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.392164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.392164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.392164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.392164] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.392164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.392164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.392164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.392164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.392164] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.893777] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.908166] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-103 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.908635] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-103" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.908635] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-103" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.909425] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-103" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.909779] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.910104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.910198] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.910430] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.910627] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.910867] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.910981] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.911098] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.911204] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.911310] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.911425] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.911610] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.957126] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.957126] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.957126] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.957126] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-103" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.957126] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-571550a9-8b1d-4af2-b0b1-a25adbd8186f taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.957126] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-571550a9-8b1d-4af2-b0b1-a25adbd8186f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.957126] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-571550a9-8b1d-4af2-b0b1-a25adbd8186f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.958504] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-571550a9-8b1d-4af2-b0b1-a25adbd8186f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.958504] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('571550a9-8b1d-4af2-b0b1-a25adbd8186f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.980595] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 725.980865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.042641] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 726.042641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.042641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.042924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.043258] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.043537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.043537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.043825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.043887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.044661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.044661] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.396874] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.461414] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.461414] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.461594] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.461804] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.461952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.462127] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 571550a9-8b1d-4af2-b0b1-a25adbd8186f not found, creating... [ 726.462384] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.462537] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.462655] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.462864] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.463039] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.463769] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.464309] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.464511] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.464810] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.465016] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.465175] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 571550a9-8b1d-4af2-b0b1-a25adbd8186f is going to be created. [ 726.497400] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.497639] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.497795] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.498117] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.498599] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.499193] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-571550a9-8b1d-4af2-b0b1-a25adbd8186f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.547133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.547345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.547403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.547640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.547834] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.547991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.548115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.548236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.548342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.548407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.549031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.549031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.549031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.549031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.549239] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.549239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.549309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.549443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.549537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.549643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.549750] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.701986] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 726.702470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.900333] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.900333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.900624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.900624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.900701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.900803] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 is going to be updated. [ 726.914501] env[65087]: INFO networking_nsxv3.common.synchronization [None req-3cf9bc2c-b528-4f8f-80b2-20c2911493e6 None None] Enqueued Resource ID: 9c4d69ab-dad4-432b-97d1-d1bfb2350a6e with Priority: HIGHEST for action port [ 726.914860] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c4d69ab-dad4-432b-97d1-d1bfb2350a6e with Priority: HIGHEST for action port [ 726.915347] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c4d69ab-dad4-432b-97d1-d1bfb2350a6e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.917035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c4d69ab-dad4-432b-97d1-d1bfb2350a6e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.917035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c4d69ab-dad4-432b-97d1-d1bfb2350a6e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.917035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c4d69ab-dad4-432b-97d1-d1bfb2350a6e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.917035] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c4d69ab-dad4-432b-97d1-d1bfb2350a6e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.933992] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.934199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.934356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.934528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.934680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.944819] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: IN_PROGRESS for 2s [ 727.053831] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbf33eac-b2a3-4597-bef7-45961c5c9915: rpc.has_security_group_logging(os_id): False [ 727.075570] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.075764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.075921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.076266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.076534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.076752] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.076921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.077356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.077627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.077739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.078075] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.078306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.078355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.078585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.078643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.080354] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.080354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.080354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.080354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.080354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.080354] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be created. [ 727.154625] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.154846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.154892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.155112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.155447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.166643] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 727.166895] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 deletion is rescheduled due to dependency. [ 727.167041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.167924] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: IN_PROGRESS for 2s [ 727.235647] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7205d17-7b81-48a3-b94f-048f8c946e4a req-cc0d66c8-f6ca-4213-b4bd-84d47cddf5c2 service nova] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_rules [ 727.235647] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7205d17-7b81-48a3-b94f-048f8c946e4a req-cc0d66c8-f6ca-4213-b4bd-84d47cddf5c2 service nova] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 727.235647] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7205d17-7b81-48a3-b94f-048f8c946e4a req-cc0d66c8-f6ca-4213-b4bd-84d47cddf5c2 service nova] Enqueued Resource ID: 571550a9-8b1d-4af2-b0b1-a25adbd8186f with Priority: HIGHEST for action port [ 727.236130] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_rules [ 727.236322] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 727.236368] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 571550a9-8b1d-4af2-b0b1-a25adbd8186f with Priority: HIGHEST for action port [ 727.236658] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.236965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.236965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.237137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.237179] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.238152] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.239153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.239781] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-571550a9-8b1d-4af2-b0b1-a25adbd8186f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.239781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-571550a9-8b1d-4af2-b0b1-a25adbd8186f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.239781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-571550a9-8b1d-4af2-b0b1-a25adbd8186f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.239962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-571550a9-8b1d-4af2-b0b1-a25adbd8186f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.239962] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('571550a9-8b1d-4af2-b0b1-a25adbd8186f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.418710] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c4d69ab-dad4-432b-97d1-d1bfb2350a6e [ 727.420607] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.420607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.420607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.420607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.420607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.420607] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c4d69ab-dad4-432b-97d1-d1bfb2350a6e already deleted. [ 727.420607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c4d69ab-dad4-432b-97d1-d1bfb2350a6e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.744780] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.744959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.745311] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 571550a9-8b1d-4af2-b0b1-a25adbd8186f with status ACTIVE [ 727.745565] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.745735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.745839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.746167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.746310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.746646] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.746771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.746823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.747072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.747201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.747475] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.747672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.747737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.748941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.748941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.749052] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 571550a9-8b1d-4af2-b0b1-a25adbd8186f is going to be updated. [ 727.770408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.770590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.770660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.770865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.771027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.771200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-571550a9-8b1d-4af2-b0b1-a25adbd8186f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.943522] env[65087]: INFO networking_nsxv3.common.synchronization [None req-19e46ec9-01d6-4e0a-b0c0-1dd71cddcce8 None None] Enqueued Resource ID: 158a974c-b9b5-4c2f-8b1a-3d99173d66ef with Priority: HIGHEST for action port [ 727.945751] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158a974c-b9b5-4c2f-8b1a-3d99173d66ef with Priority: HIGHEST for action port [ 727.946215] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-158a974c-b9b5-4c2f-8b1a-3d99173d66ef taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.946326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-158a974c-b9b5-4c2f-8b1a-3d99173d66ef" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.946326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-158a974c-b9b5-4c2f-8b1a-3d99173d66ef" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.946775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-158a974c-b9b5-4c2f-8b1a-3d99173d66ef" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.946884] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('158a974c-b9b5-4c2f-8b1a-3d99173d66ef',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.101749] env[65087]: INFO networking_nsxv3.common.synchronization [req-66ffcff2-48c8-476f-ba3b-171b5c15aec7 req-31f50aae-1dcf-450e-a72b-041ca1e35d1e tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_members [ 728.102366] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGHEST for action security_group_members [ 728.102863] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-75619e08-1842-4450-8de1-688a542e6f15 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.103175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.103306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.103484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.103644] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.103742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.103811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.104524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.104524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.104524] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.451425] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 158a974c-b9b5-4c2f-8b1a-3d99173d66ef [ 728.451701] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.451895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.451996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.452298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.454881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.454881] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:158a974c-b9b5-4c2f-8b1a-3d99173d66ef already deleted. [ 728.454881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-158a974c-b9b5-4c2f-8b1a-3d99173d66ef" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.607965] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.608778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.608778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.609036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.635025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.635025] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.635025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.635025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.635025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.635025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.635025] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75619e08-1842-4450-8de1-688a542e6f15 is going to be updated. [ 728.664582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.664780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.664891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.665209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.666035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.676407] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75619e08-1842-4450-8de1-688a542e6f15 in Status: IN_PROGRESS for 2s [ 728.749162] env[65087]: INFO networking_nsxv3.common.synchronization [req-296ec80c-dbb5-457f-a73c-d000e1ffb098 req-95eab9f9-ddfe-487b-ac70-e90de92f61a7 tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 728.749162] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 728.749280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.749413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.749520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.749753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.749916] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.750156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.750257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.750447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.750565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.750681] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.959260] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: SUCCESS [ 728.959260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.959260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.959260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.959260] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.959260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.959260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.959260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.959260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.959260] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.180605] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 729.180605] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.208215] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.208396] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.208512] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.208924] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.209231] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.209386] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.211029] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.211029] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.211029] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.211029] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.211029] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.211029] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.211029] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.211029] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 729.211339] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.211339] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.229506] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.229690] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 729.229845] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.230204] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.231622] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.231622] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.231622] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.231622] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.231622] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.253568] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.253730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.253778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.253987] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.254087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.254359] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.254512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.254626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.254815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.254976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.255666] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 already deleted. [ 729.255666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.461408] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.735302] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.735998] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.735998] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.735998] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.736167] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.736250] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c not found, creating... [ 729.736473] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.736624] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.736731] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.736936] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.737197] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.737340] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.737487] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.737602] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.737931] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.738181] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.738181] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c is going to be created. [ 729.759812] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.760292] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.760422] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.760680] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.760906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.761195] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.969252] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.297017] env[65087]: INFO networking_nsxv3.common.synchronization [None req-2d57715d-b484-411b-a944-4060099edfd3 None None] Enqueued Resource ID: 0a77cb1a-5342-4c43-ade9-13ae12c86ae3 with Priority: HIGHEST for action port [ 730.297408] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a77cb1a-5342-4c43-ade9-13ae12c86ae3 with Priority: HIGHEST for action port [ 730.297884] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a77cb1a-5342-4c43-ade9-13ae12c86ae3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.298017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a77cb1a-5342-4c43-ade9-13ae12c86ae3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.298091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a77cb1a-5342-4c43-ade9-13ae12c86ae3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.298349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a77cb1a-5342-4c43-ade9-13ae12c86ae3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.298434] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a77cb1a-5342-4c43-ade9-13ae12c86ae3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.472878] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.473046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.473130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.473361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.473454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.473611] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 is going to be updated. [ 730.494850] env[65087]: INFO networking_nsxv3.common.synchronization [req-296ec80c-dbb5-457f-a73c-d000e1ffb098 req-3db9c446-8ed9-40e2-b1da-bbc0b235e57e service nova] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 730.494850] env[65087]: INFO networking_nsxv3.common.synchronization [req-296ec80c-dbb5-457f-a73c-d000e1ffb098 req-3db9c446-8ed9-40e2-b1da-bbc0b235e57e service nova] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 730.495018] env[65087]: INFO networking_nsxv3.common.synchronization [req-296ec80c-dbb5-457f-a73c-d000e1ffb098 req-3db9c446-8ed9-40e2-b1da-bbc0b235e57e service nova] Enqueued Resource ID: 09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c with Priority: HIGHEST for action port [ 730.495482] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 730.496776] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 730.496776] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c with Priority: HIGHEST for action port [ 730.496776] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.499514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.499593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.499807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.499918] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.500860] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.500991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.501084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.501290] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.501467] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.501573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.501634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.501796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.501885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.501989] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.502871] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.502974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.503148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.503327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.503417] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.505754] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.505857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.505923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.506084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.506216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.517157] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: IN_PROGRESS for 2s [ 730.525259] env[65087]: INFO networking_nsxv3.common.synchronization [None req-050c3342-e309-4529-8b9c-e4ce97294fb6 None None] Enqueued Resource ID: 5666ad72-4a83-41a6-831f-8c1836444351 with Priority: HIGHEST for action port [ 730.525771] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5666ad72-4a83-41a6-831f-8c1836444351 with Priority: HIGHEST for action port [ 730.527030] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5666ad72-4a83-41a6-831f-8c1836444351 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.527030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5666ad72-4a83-41a6-831f-8c1836444351" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.527030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5666ad72-4a83-41a6-831f-8c1836444351" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.527527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5666ad72-4a83-41a6-831f-8c1836444351" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.527527] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5666ad72-4a83-41a6-831f-8c1836444351',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.688116] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75619e08-1842-4450-8de1-688a542e6f15 in Status: SUCCESS [ 730.688116] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75619e08-1842-4450-8de1-688a542e6f15 deletion is rescheduled due to dependency. [ 730.688116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.804068] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a77cb1a-5342-4c43-ade9-13ae12c86ae3 [ 730.804068] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.804068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.804222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.804657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.804657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.804657] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a77cb1a-5342-4c43-ade9-13ae12c86ae3 already deleted. [ 730.804657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a77cb1a-5342-4c43-ade9-13ae12c86ae3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.006496] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c with status ACTIVE [ 731.006746] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.006920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.006920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.007178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.007261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.007383] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.007484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.008737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.008737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.008737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.008737] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.009327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.009563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.009772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.009772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.009858] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c is going to be updated. [ 731.011073] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.011272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.011727] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.031972] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5666ad72-4a83-41a6-831f-8c1836444351 [ 731.032339] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.032492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.032586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.032767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.032882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.033092] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5666ad72-4a83-41a6-831f-8c1836444351 already deleted. [ 731.033215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5666ad72-4a83-41a6-831f-8c1836444351" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.052596] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.052596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.052596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.052596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.052757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.052857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09b8c795-1807-48bf-a0b0-a2fc5b1ecb8c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.189390] env[65087]: INFO networking_nsxv3.common.synchronization [req-140f36b5-b371-43e3-87a7-4b1addcc27de req-fcda781d-dc1e-4d70-9b94-3494ed01e4c6 tempest-ServersAdminTestJSON-1882897549 tempest-ServersAdminTestJSON-1882897549-project-member] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 731.189589] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 731.189920] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.190034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.190366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.190607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.190804] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.190892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.190955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.191316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.191389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.191455] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.514300] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.694906] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.915677] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.915939] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.916068] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.916333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.916601] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.916817] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.916877] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.917126] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.917268] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.917497] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.920389] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.920389] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.920389] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.920389] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.920389] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.920389] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.947706] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.947755] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.948055] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.948704] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.950601] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.950601] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.950601] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.950601] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.950601] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0213bd7-50de-423a-bc0e-2c36e7e7cb38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.017028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.017028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.017028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.017028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.017028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.017478] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be created. [ 732.047151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.047151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.047151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.047151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.047151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.056498] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: UNINITIALIZED for 2s [ 732.198758] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.454681] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.454906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.454948] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.455353] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.455469] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.455680] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port b0213bd7-50de-423a-bc0e-2c36e7e7cb38 not found, creating... [ 732.455893] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.456296] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.456296] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.456501] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.456647] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.456828] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.457142] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.457142] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.457300] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.457426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.457555] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: b0213bd7-50de-423a-bc0e-2c36e7e7cb38 is going to be created. [ 732.495435] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.495741] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.495836] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.496149] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.497198] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.497198] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.527788] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: SUCCESS [ 732.529998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.529998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.529998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.529998] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.529998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.529998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.529998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.529998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.529998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.529998] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.700145] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.700334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.700456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.700709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.700843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.701676] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 732.731642] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.731814] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.731905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.732148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.732306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.742011] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 732.745482] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc392272-6990-4d8b-b11e-3f61a0abf757 req-e2858531-4a21-462f-ba70-1cfc8742029d tempest-AttachInterfacesV270Test-459864844 tempest-AttachInterfacesV270Test-459864844-project-member] Enqueued Resource ID: 082fc1a8-0a58-4162-926b-fe01957908a7 with Priority: HIGHEST for action security_group_members [ 732.745570] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082fc1a8-0a58-4162-926b-fe01957908a7 with Priority: HIGHEST for action security_group_members [ 732.745831] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-082fc1a8-0a58-4162-926b-fe01957908a7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.745972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.746291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.746563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.746787] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.746873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.746873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.747041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.747131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.747227] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('082fc1a8-0a58-4162-926b-fe01957908a7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.797503] env[65087]: INFO networking_nsxv3.common.synchronization [None req-28bb15ea-4aad-450d-bcba-d583675a12e5 None None] Enqueued Resource ID: 28d38361-f97d-459f-941e-98fd44c6aa29 with Priority: HIGHEST for action port [ 732.798098] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28d38361-f97d-459f-941e-98fd44c6aa29 with Priority: HIGHEST for action port [ 732.798431] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-28d38361-f97d-459f-941e-98fd44c6aa29 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.798566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28d38361-f97d-459f-941e-98fd44c6aa29" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.798635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28d38361-f97d-459f-941e-98fd44c6aa29" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.798888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28d38361-f97d-459f-941e-98fd44c6aa29" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.798969] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28d38361-f97d-459f-941e-98fd44c6aa29',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.031705] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.031874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.031931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.032183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.032360] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.032468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.032534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.032687] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.032777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.032876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.033036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.033102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.033275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.033514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.033702] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.033853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.033924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.034080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.034162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.034289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.034469] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.209665] env[65087]: INFO networking_nsxv3.common.synchronization [req-140f36b5-b371-43e3-87a7-4b1addcc27de req-69b928f5-f6e5-4f31-9c59-85145a0ba61e service nova] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_rules [ 733.209868] env[65087]: INFO networking_nsxv3.common.synchronization [req-140f36b5-b371-43e3-87a7-4b1addcc27de req-69b928f5-f6e5-4f31-9c59-85145a0ba61e service nova] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 733.210017] env[65087]: INFO networking_nsxv3.common.synchronization [req-140f36b5-b371-43e3-87a7-4b1addcc27de req-69b928f5-f6e5-4f31-9c59-85145a0ba61e service nova] Enqueued Resource ID: b0213bd7-50de-423a-bc0e-2c36e7e7cb38 with Priority: HIGHEST for action port [ 733.210540] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_rules [ 733.212893] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 733.212984] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0213bd7-50de-423a-bc0e-2c36e7e7cb38 with Priority: HIGHEST for action port [ 733.213370] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.213502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.213574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.213779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.213861] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.215048] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.215159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.215611] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.215722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.218177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.218177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.218177] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0213bd7-50de-423a-bc0e-2c36e7e7cb38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.221227] env[65087]: INFO networking_nsxv3.common.synchronization [None req-e6379d0d-1970-4607-a6f4-c95e6fd18f94 tempest-AttachVolumeShelveTestJSON-1249647460 tempest-AttachVolumeShelveTestJSON-1249647460-project-member] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_rules [ 733.221561] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_rules [ 733.222348] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.222348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.222348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.222348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.222348] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.249744] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.250618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.251354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.251354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.251354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.251533] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.251727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.251727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.251883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.251965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.252067] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 082fc1a8-0a58-4162-926b-fe01957908a7 already deleted. [ 733.252164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.301127] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28d38361-f97d-459f-941e-98fd44c6aa29 [ 733.305029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.305029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.305029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.305029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.305029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.305029] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28d38361-f97d-459f-941e-98fd44c6aa29 already deleted. [ 733.305029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28d38361-f97d-459f-941e-98fd44c6aa29" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.534268] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.534709] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-463" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.534709] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-463" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.535032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-463" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.535594] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.535822] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.535964] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.536209] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.536350] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.536553] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.536951] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.536951] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.536951] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.536951] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.537178] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.537216] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.538590] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8: rpc.has_security_group_logging(os_id): False [ 733.559082] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.559248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.559333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.559542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.559633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.559851] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.559956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.560248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.560248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.560248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.560445] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.560538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.560598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.560736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.560808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.561241] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.561413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.561496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.561648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.561730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.561820] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 is going to be updated. [ 733.563964] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.564155] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.564512] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.564512] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-463" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.564721] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-a60395ec-9e1f-4ff1-b7bb-c959a5201319 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.564854] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-a60395ec-9e1f-4ff1-b7bb-c959a5201319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.564996] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-a60395ec-9e1f-4ff1-b7bb-c959a5201319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.565271] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-a60395ec-9e1f-4ff1-b7bb-c959a5201319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.565430] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a60395ec-9e1f-4ff1-b7bb-c959a5201319',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.568697] env[65087]: INFO networking_nsxv3.common.synchronization [req-99daebe8-b505-4d28-88a6-37e42b16c05a req-6685779e-c294-4838-a57d-c56137dd749d tempest-MultipleCreateTestJSON-1770125270 tempest-MultipleCreateTestJSON-1770125270-project-member] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 733.569384] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 733.569666] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.569779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.569849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.570033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.570193] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.570292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.570353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.570495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.570577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.570664] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.639765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.639964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.640052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.640256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.640413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.657204] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: IN_PROGRESS for 2s [ 733.660355] env[65087]: INFO networking_nsxv3.common.synchronization [None req-15be54c0-df1f-4431-8448-438ee4dab1b1 tempest-AttachVolumeShelveTestJSON-1249647460 tempest-AttachVolumeShelveTestJSON-1249647460-project-member] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_rules [ 733.660969] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_rules [ 733.661357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.661514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.719156] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.719378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.719438] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0213bd7-50de-423a-bc0e-2c36e7e7cb38 with status ACTIVE [ 733.719604] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.719714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.719788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.720186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.720186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.720271] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.720370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.720439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.720587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.720664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.720843] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.720932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.720995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.721294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.721439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.721546] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0213bd7-50de-423a-bc0e-2c36e7e7cb38 is going to be updated. [ 733.773055] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.773303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.773380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.773632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.773691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.773785] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ae9556d-2824-4426-9646-69904ca4036b already deleted. [ 733.773866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.774021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.774176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.774263] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.779458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.779633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.779712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.779914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.780095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.780310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0213bd7-50de-423a-bc0e-2c36e7e7cb38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.065865] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 734.066133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.066358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.066648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.066877] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.067043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.067124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.067560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.067696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.067825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.068077] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.070115] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.070365] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.070533] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.070781] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.070914] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.071101] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port a60395ec-9e1f-4ff1-b7bb-c959a5201319 not found, creating... [ 734.071350] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.071506] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.071637] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.071848] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.071979] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.072265] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.072413] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.072526] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.072792] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.072992] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.073171] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: a60395ec-9e1f-4ff1-b7bb-c959a5201319 is going to be created. [ 734.074256] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.094579] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.094844] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.094967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.095251] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.095474] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.095731] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-a60395ec-9e1f-4ff1-b7bb-c959a5201319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.340163] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.340339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.340425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.340651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.340748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.340845] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ae9556d-2824-4426-9646-69904ca4036b already deleted. [ 734.340927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.573041] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.576496] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.757496] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 734.758121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.758535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.758888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.759303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.760017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.760017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.760017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.760017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.760017] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.844461] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc392272-6990-4d8b-b11e-3f61a0abf757 req-7972681e-0608-41ae-b7f9-7d0e13fe5121 service nova] Enqueued Resource ID: 082fc1a8-0a58-4162-926b-fe01957908a7 with Priority: HIGHEST for action security_group_rules [ 734.844634] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc392272-6990-4d8b-b11e-3f61a0abf757 req-7972681e-0608-41ae-b7f9-7d0e13fe5121 service nova] Enqueued Resource ID: 082fc1a8-0a58-4162-926b-fe01957908a7 with Priority: HIGHEST for action security_group_members [ 734.844767] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc392272-6990-4d8b-b11e-3f61a0abf757 req-7972681e-0608-41ae-b7f9-7d0e13fe5121 service nova] Enqueued Resource ID: a60395ec-9e1f-4ff1-b7bb-c959a5201319 with Priority: HIGHEST for action port [ 734.845298] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082fc1a8-0a58-4162-926b-fe01957908a7 with Priority: HIGHEST for action security_group_rules [ 734.845461] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082fc1a8-0a58-4162-926b-fe01957908a7 with Priority: HIGHEST for action security_group_members [ 734.845561] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a60395ec-9e1f-4ff1-b7bb-c959a5201319 with Priority: HIGHEST for action port [ 734.845905] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-082fc1a8-0a58-4162-926b-fe01957908a7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.849028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.849028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.850188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.850188] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('082fc1a8-0a58-4162-926b-fe01957908a7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.850578] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-082fc1a8-0a58-4162-926b-fe01957908a7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.850704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.850811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.850957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.851147] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.851251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.851318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.851464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.851549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.851645] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('082fc1a8-0a58-4162-926b-fe01957908a7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.852903] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-a60395ec-9e1f-4ff1-b7bb-c959a5201319 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.853051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a60395ec-9e1f-4ff1-b7bb-c959a5201319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.853099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a60395ec-9e1f-4ff1-b7bb-c959a5201319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.853331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a60395ec-9e1f-4ff1-b7bb-c959a5201319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.853408] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a60395ec-9e1f-4ff1-b7bb-c959a5201319',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.074138] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3411048-5318-4245-bd13-ad8c65f4de91: rpc.has_security_group_logging(os_id): False [ 735.082888] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.082888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.082888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.082888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.082888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.082888] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 735.110553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.110553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.110553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.110553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.110553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.110553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.110553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.110553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.110553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.110553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.110553] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be created. [ 735.135616] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.136376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.136807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.137182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.137479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.147711] env[65087]: INFO networking_nsxv3.common.synchronization [req-ed75b2b7-6ab7-464f-98a1-6aac8f5bcfeb req-146c8d90-f662-4780-bc32-218270c4f2bd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 735.147711] env[65087]: INFO networking_nsxv3.common.synchronization [req-ed75b2b7-6ab7-464f-98a1-6aac8f5bcfeb req-146c8d90-f662-4780-bc32-218270c4f2bd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 735.149347] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 735.150391] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 735.150783] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 735.151286] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.153079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.153079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.153079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.153079] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.153079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.153079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.153079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.153079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.153079] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.159180] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.159180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.159525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.160012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.162351] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.162351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.162351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.162351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.162351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.162351] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.193407] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.193559] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.193768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.193836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.194029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.210055] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 735.223575] env[65087]: INFO networking_nsxv3.common.synchronization [req-ed75b2b7-6ab7-464f-98a1-6aac8f5bcfeb req-146c8d90-f662-4780-bc32-218270c4f2bd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_rules [ 735.223838] env[65087]: INFO networking_nsxv3.common.synchronization [req-ed75b2b7-6ab7-464f-98a1-6aac8f5bcfeb req-146c8d90-f662-4780-bc32-218270c4f2bd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 735.223838] env[65087]: INFO networking_nsxv3.common.synchronization [req-ed75b2b7-6ab7-464f-98a1-6aac8f5bcfeb req-146c8d90-f662-4780-bc32-218270c4f2bd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 735.223981] env[65087]: INFO networking_nsxv3.common.synchronization [req-ed75b2b7-6ab7-464f-98a1-6aac8f5bcfeb req-146c8d90-f662-4780-bc32-218270c4f2bd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 735.224387] env[65087]: INFO networking_nsxv3.common.synchronization [req-ed75b2b7-6ab7-464f-98a1-6aac8f5bcfeb req-146c8d90-f662-4780-bc32-218270c4f2bd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with Priority: HIGHEST for action port [ 735.224794] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_rules [ 735.224972] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 735.225091] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with Priority: HIGHEST for action port [ 735.225186] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 735.225279] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 735.226375] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.226375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.226375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.226375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.226375] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.227249] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.232025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.232138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.232432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.232432] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.233500] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.233622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.233719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.233863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.233939] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.236620] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.236620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.236620] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.236620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.264659] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.357191] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('082fc1a8-0a58-4162-926b-fe01957908a7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.357191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-082fc1a8-0a58-4162-926b-fe01957908a7 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.357191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.358466] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a60395ec-9e1f-4ff1-b7bb-c959a5201319 with status ACTIVE [ 735.358466] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.358466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.358466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.358841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.358841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.358971] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.359331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.359549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.359750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.359869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.360902] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.362888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.362888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.362888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.362888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.362888] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a60395ec-9e1f-4ff1-b7bb-c959a5201319 is going to be updated. [ 735.394291] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.394291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.394291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.394291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.394291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.394291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a60395ec-9e1f-4ff1-b7bb-c959a5201319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.662915] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.665064] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.676261] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: SUCCESS [ 735.676261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.737818] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.738087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.738771] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.738968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.739251] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with status ACTIVE [ 735.739745] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.739745] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.739873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.740253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.740441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.740732] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.740908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.741045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.741330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.741486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.741799] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.741973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.742803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.742803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.742966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.743204] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 is going to be updated. [ 735.769034] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.769340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.769569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.769777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.769926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.770149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.770501] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.858619] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('082fc1a8-0a58-4162-926b-fe01957908a7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.168106] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.169215] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.216839] env[65087]: INFO networking_nsxv3.common.synchronization [req-279394bf-426a-4991-ad93-d06db9c67347 req-a2c38a4e-9a35-45fe-ac14-76bbdd21bca8 tempest-MultipleCreateTestJSON-1770125270 tempest-MultipleCreateTestJSON-1770125270-project-member] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 736.220840] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 736.221620] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.221955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.273233] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.273407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.273502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.273788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.273942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.274209] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 736.313647] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.313835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.313912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.314134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.314300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.331517] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 736.363056] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.363056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.363056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.363056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.363056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.363056] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 082fc1a8-0a58-4162-926b-fe01957908a7 is going to be created. [ 736.387996] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.390930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.390930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.390930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.390930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.399062] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082fc1a8-0a58-4162-926b-fe01957908a7 in Status: UNINITIALIZED for 2s [ 736.670989] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.671447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.671447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.671519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.671570] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.671805] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba is going to be created. [ 736.672979] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.673406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.673612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.673960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.674074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.674173] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 736.702121] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.702312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.702503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.702590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.702761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.710621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.710707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.710740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.710964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.711094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.717274] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: UNINITIALIZED for 2s [ 736.722710] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 736.893250] env[65087]: INFO networking_nsxv3.common.synchronization [req-1d29d36c-b1ee-4dd7-8e7a-e3a93cfbcedc req-f3e376f3-5704-4c4d-9764-cf894714cadd tempest-ServerRescueNegativeTestJSON-853652026 tempest-ServerRescueNegativeTestJSON-853652026-project-member] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 736.894151] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 736.894645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.894846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.894973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.895275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.895583] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.895761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.898706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.898706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.898706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.898706] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.165848] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 737.165848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.165848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.165848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.165848] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.165848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.165848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.165848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.165848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.165848] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.224781] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 737.225302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.402379] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.521701] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.522158] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.523317] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.523317] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.524578] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.524765] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.526179] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.526179] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.526179] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.526179] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.526340] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.526454] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.526613] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.526777] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.526930] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.527136] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.550770] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.550770] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.550770] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.550770] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.550770] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-82cb4156-a299-4b14-91de-6a276dcb04a6 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.550770] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-82cb4156-a299-4b14-91de-6a276dcb04a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.550770] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-82cb4156-a299-4b14-91de-6a276dcb04a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.550770] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-82cb4156-a299-4b14-91de-6a276dcb04a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.550770] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cb4156-a299-4b14-91de-6a276dcb04a6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.674316] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.674316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.674316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.674316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.674316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.674316] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.674316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.674316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.674316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.674316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.674316] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 737.712591] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.712754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.712823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.713072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.713317] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.726670] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 737.905075] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.052909] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.053261] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.053389] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.053680] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.053827] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.053978] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 82cb4156-a299-4b14-91de-6a276dcb04a6 not found, creating... [ 738.054262] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.054417] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.054526] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.054738] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.054872] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.055159] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.055307] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.055429] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.055662] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.055789] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.055922] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 82cb4156-a299-4b14-91de-6a276dcb04a6 is going to be created. [ 738.080526] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.080816] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.080816] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.081189] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.081615] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.081909] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-82cb4156-a299-4b14-91de-6a276dcb04a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.342302] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 738.342522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.342805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.343123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.343569] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.343779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.344345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.344345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.344473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.344574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.344730] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.407770] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.407924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.408016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.408238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.408356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.408462] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be updated. [ 738.410706] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082fc1a8-0a58-4162-926b-fe01957908a7 in Status: SUCCESS [ 738.410939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.411137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.411374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.411672] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.411824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.411914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.412166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.412311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.412440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.412565] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('082fc1a8-0a58-4162-926b-fe01957908a7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.443781] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.443948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.444377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.444377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.444526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.457447] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: IN_PROGRESS for 2s [ 738.730923] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: SUCCESS [ 738.731322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.731515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.731818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.732089] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.732266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.732366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.732602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.732728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.732879] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.737386] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 738.737386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.737386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.737386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.737386] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.737386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.737386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.737839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.737839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.737839] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.815874] env[65087]: INFO networking_nsxv3.common.synchronization [req-1d29d36c-b1ee-4dd7-8e7a-e3a93cfbcedc req-37251fac-d027-4a4a-a3ab-3ebbac826245 service nova] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_rules [ 738.815874] env[65087]: INFO networking_nsxv3.common.synchronization [req-1d29d36c-b1ee-4dd7-8e7a-e3a93cfbcedc req-37251fac-d027-4a4a-a3ab-3ebbac826245 service nova] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 738.815874] env[65087]: INFO networking_nsxv3.common.synchronization [req-1d29d36c-b1ee-4dd7-8e7a-e3a93cfbcedc req-37251fac-d027-4a4a-a3ab-3ebbac826245 service nova] Enqueued Resource ID: 82cb4156-a299-4b14-91de-6a276dcb04a6 with Priority: HIGHEST for action port [ 738.815874] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_rules [ 738.815874] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 738.815874] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82cb4156-a299-4b14-91de-6a276dcb04a6 with Priority: HIGHEST for action port [ 738.815874] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.816295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.816295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.816394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.816494] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.817496] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.818497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.818778] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-82cb4156-a299-4b14-91de-6a276dcb04a6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.819735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82cb4156-a299-4b14-91de-6a276dcb04a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.819836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82cb4156-a299-4b14-91de-6a276dcb04a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.820077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82cb4156-a299-4b14-91de-6a276dcb04a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.820187] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cb4156-a299-4b14-91de-6a276dcb04a6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.848782] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.848782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.848782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.849074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.849074] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.849161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.849223] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.849376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.849480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.849567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.849740] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.850885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.850885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.850885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.850885] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.850885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.850885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.850885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.850885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.850885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.850885] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.917541] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-082fc1a8-0a58-4162-926b-fe01957908a7 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.917541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.917541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.917774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.918040] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.918151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.918217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.919367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.919517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.919625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.919788] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-082fc1a8-0a58-4162-926b-fe01957908a7 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.919890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.920032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.920145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.920290] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.920633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.921534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.921729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.921812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.921900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.922020] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('082fc1a8-0a58-4162-926b-fe01957908a7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.238615] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.240889] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.322375] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.322546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.325974] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82cb4156-a299-4b14-91de-6a276dcb04a6 with status ACTIVE [ 739.326205] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.326337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.326402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.326616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.326703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.326876] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.327014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.327080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.327231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.327303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.327479] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.327566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.327625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.327760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.327886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.327975] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82cb4156-a299-4b14-91de-6a276dcb04a6 is going to be updated. [ 739.353404] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f: rpc.has_security_group_logging(os_id): False [ 739.363704] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.363876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.363919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.366074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.366074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.366074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82cb4156-a299-4b14-91de-6a276dcb04a6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.378582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.378582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.378582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.378582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.378582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.379879] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.379879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.379879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.379879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.379879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.379879] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.379879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.379879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.379879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.379879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.380229] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.380229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.380229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.380373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.380373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.380498] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 739.424413] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 082fc1a8-0a58-4162-926b-fe01957908a7: rpc.has_security_group_logging(os_id): False [ 739.444833] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.444998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.445077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.445300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.445389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.446398] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.446522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.446603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.446785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.446864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.447103] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.447158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.447220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.447357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.447431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.447607] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.447729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.447763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.448660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.448660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.448660] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 082fc1a8-0a58-4162-926b-fe01957908a7 is going to be created. [ 739.494959] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.495625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.495625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.495771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.495930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.525891] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 739.537295] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.537295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.537295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.537295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.537295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.563949] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 082fc1a8-0a58-4162-926b-fe01957908a7 in Status: IN_PROGRESS for 2s [ 739.739481] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 739.739820] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a deletion is rescheduled due to dependency. [ 739.740108] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.740860] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.744015] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.245038] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.245038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.245038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.245038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.245038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.245038] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba is going to be updated. [ 740.249721] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.250026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.250168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.250477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.250646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.250811] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 740.312975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.313077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.313114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.313846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.313846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.315938] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.316102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.316182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.316408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.316561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.334330] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 740.335242] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: IN_PROGRESS for 2s [ 740.470187] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 740.470852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.470852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.470963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.471332] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.471474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.471549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.472911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.472911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.472911] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.974340] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.479234] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.568995] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 741.569595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.579182] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 082fc1a8-0a58-4162-926b-fe01957908a7 in Status: SUCCESS [ 741.579387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.985222] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.985222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.985222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.985222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.985222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.985222] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be updated. [ 742.016728] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.016876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.016950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.017280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.019162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.030315] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: IN_PROGRESS for 2s [ 742.348832] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 742.349195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.350099] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: SUCCESS [ 742.350306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.350475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.350709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.350925] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.351062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.351260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.351465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.351521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.351610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.351708] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.352566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.352741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.352923] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.353047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.353111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.353813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.353813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.353813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.353813] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.441444] env[65087]: INFO networking_nsxv3.common.synchronization [None req-cecd0695-85d8-45e5-891a-ec7af041f45e None None] Enqueued Resource ID: 97714d04-0d81-444b-bfe0-e11bdab8b7dc with Priority: HIGHEST for action port [ 742.441976] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97714d04-0d81-444b-bfe0-e11bdab8b7dc with Priority: HIGHEST for action port [ 742.442371] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-97714d04-0d81-444b-bfe0-e11bdab8b7dc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.442496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97714d04-0d81-444b-bfe0-e11bdab8b7dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.442573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97714d04-0d81-444b-bfe0-e11bdab8b7dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.442931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97714d04-0d81-444b-bfe0-e11bdab8b7dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.443024] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97714d04-0d81-444b-bfe0-e11bdab8b7dc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.855877] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.856105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.856160] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.857151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.857151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.857151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.857151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.857151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.857151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.857151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.857151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.857424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.857424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.857424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.857604] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.857686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.857686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.857817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.857888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.857993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.858095] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.859018] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.946679] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97714d04-0d81-444b-bfe0-e11bdab8b7dc [ 742.946941] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.947458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.947458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.948653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.948653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.948653] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97714d04-0d81-444b-bfe0-e11bdab8b7dc already deleted. [ 742.948653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97714d04-0d81-444b-bfe0-e11bdab8b7dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.362956] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3c0a5a-197c-4c4c-a82b-9342302fe922: rpc.has_security_group_logging(os_id): False [ 743.363899] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6dd9b03-d553-4b7a-b9f5-f9e3b715daba: rpc.has_security_group_logging(os_id): False [ 743.386232] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.386232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.386232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.386232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.386232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.386232] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.386232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.386232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.386232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.386954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.387032] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba is going to be created. [ 743.389275] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.389620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.389620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.389620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.389844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.393027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.393027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.393027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.393027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.393027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.393027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.393027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.393027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.393027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.393027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.393694] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.393694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.393694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.393881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.393881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.393983] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 743.474301] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.474301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.474301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.474301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.474620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.476830] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.476974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.477041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.477222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.477510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.492999] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: IN_PROGRESS for 2s [ 743.505494] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 743.835583] env[65087]: INFO networking_nsxv3.common.synchronization [req-f82027d3-3efc-4a7f-aa6d-5af94535e10d req-2eb7f77a-e046-415b-af66-05577defe2b3 tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 743.836940] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 743.837210] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.837344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.837417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.837849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.838203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.838203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.838355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.838408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.838462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.838579] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.041479] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 744.041726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.041932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.042193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.042392] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.042515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.042606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.042734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.042822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.043872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.044022] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.342096] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.342297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.342353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.342543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.342631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.342827] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.342934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.342977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.343411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.343411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.343411] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 744.384821] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.385195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.385234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.385511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.385997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.401756] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 744.545996] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.546288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.546288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.546774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.546774] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.546774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.547018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.547018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.547099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.547179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.547329] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.547450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.547500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.547621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.547757] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.547847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.547906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.548053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.548133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.548224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.548305] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.819639] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.819922] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.819958] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.820268] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.820521] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.820668] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.820777] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.820993] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.822562] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.822781] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.822891] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.822996] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.823123] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.823225] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.823364] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.823493] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.845331] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.845534] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.845632] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.845786] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.846115] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.846285] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.846400] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.846710] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.846843] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.965530] env[65087]: INFO networking_nsxv3.common.synchronization [None req-83766e16-3279-4694-95a8-4c0b0b2c79c2 None None] Enqueued Resource ID: 21595415-d42d-494f-9ca5-455c5bebda95 with Priority: HIGHEST for action port [ 744.965967] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21595415-d42d-494f-9ca5-455c5bebda95 with Priority: HIGHEST for action port [ 744.966282] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-21595415-d42d-494f-9ca5-455c5bebda95 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.966400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21595415-d42d-494f-9ca5-455c5bebda95" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.966492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21595415-d42d-494f-9ca5-455c5bebda95" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.966709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21595415-d42d-494f-9ca5-455c5bebda95" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.968493] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21595415-d42d-494f-9ca5-455c5bebda95',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.051677] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbf33eac-b2a3-4597-bef7-45961c5c9915: rpc.has_security_group_logging(os_id): False [ 745.071961] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.072149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.072234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.072493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.072572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.072804] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.073097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.073097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.073207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.073293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.073442] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.073550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.073624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.073764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.073840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.074122] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.074260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.074298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.074539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.074615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.074703] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be updated. [ 745.144743] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.144893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.144983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.145828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.146083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.161384] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: IN_PROGRESS for 2s [ 745.348895] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.349180] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.349314] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.349583] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.349739] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.349890] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec not found, creating... [ 745.350196] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.350350] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.350460] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.350691] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.350827] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.351132] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.351327] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.351436] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.351653] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.351787] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.351925] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec is going to be created. [ 745.380651] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.380922] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.381080] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.381629] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.381734] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.381973] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.471761] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21595415-d42d-494f-9ca5-455c5bebda95 [ 745.472187] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.472280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.472353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.472526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.472622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.472721] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21595415-d42d-494f-9ca5-455c5bebda95 already deleted. [ 745.472804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21595415-d42d-494f-9ca5-455c5bebda95" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.522869] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: SUCCESS [ 745.523256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.530562] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 745.530841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.552790] env[65087]: INFO networking_nsxv3.common.synchronization [None req-522e2f07-0f06-4483-8592-14c3d358c86e None None] Enqueued Resource ID: 157d873f-8184-4756-9229-4df096ef18d3 with Priority: HIGHEST for action port [ 745.553709] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 157d873f-8184-4756-9229-4df096ef18d3 with Priority: HIGHEST for action port [ 745.554442] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-157d873f-8184-4756-9229-4df096ef18d3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.554659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-157d873f-8184-4756-9229-4df096ef18d3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.554723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-157d873f-8184-4756-9229-4df096ef18d3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.555353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-157d873f-8184-4756-9229-4df096ef18d3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.556062] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('157d873f-8184-4756-9229-4df096ef18d3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.059490] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 157d873f-8184-4756-9229-4df096ef18d3 [ 746.059944] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.060222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.060368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.060676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.060841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.061017] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:157d873f-8184-4756-9229-4df096ef18d3 already deleted. [ 746.061171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-157d873f-8184-4756-9229-4df096ef18d3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.133532] env[65087]: INFO networking_nsxv3.common.synchronization [req-f82027d3-3efc-4a7f-aa6d-5af94535e10d req-18db801c-680e-46c4-a769-e6cc2cdbecf9 service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 746.133532] env[65087]: INFO networking_nsxv3.common.synchronization [req-f82027d3-3efc-4a7f-aa6d-5af94535e10d req-18db801c-680e-46c4-a769-e6cc2cdbecf9 service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 746.133532] env[65087]: INFO networking_nsxv3.common.synchronization [req-f82027d3-3efc-4a7f-aa6d-5af94535e10d req-18db801c-680e-46c4-a769-e6cc2cdbecf9 service nova] Enqueued Resource ID: 0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec with Priority: HIGHEST for action port [ 746.136882] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 746.137093] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 746.137218] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec with Priority: HIGHEST for action port [ 746.137683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.137885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.137995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.138323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.138445] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.145269] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.145269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.145269] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.145269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.145269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.145611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.145611] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.414189] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 746.414379] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 deletion is rescheduled due to dependency. [ 746.414500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.414667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.415908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.415908] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.415908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.415908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.415908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.415908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.415908] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.648210] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.648616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.650847] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec with status ACTIVE [ 746.651042] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.651378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.651500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.651793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.652130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.652488] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.652639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.652743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.652974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.653202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.653579] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.653679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.653952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.653952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.654053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.654148] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec is going to be updated. [ 746.677849] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.678072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.678072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.678676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.678676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.678676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0594a0dd-5ec0-4290-87e4-0c4ffc0e13ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.922497] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.178684] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 747.178958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.427781] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.932642] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.936225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.936225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.936225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.936225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.936225] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 747.972163] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.972163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.972163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.972163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.972163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.981189] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 748.043323] env[65087]: INFO networking_nsxv3.common.synchronization [None req-07615179-9a91-45ae-94d3-943cb55ca319 None None] Enqueued Resource ID: ea743979-0dfa-4921-a12b-5064bbda2384 with Priority: HIGHEST for action port [ 748.045866] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea743979-0dfa-4921-a12b-5064bbda2384 with Priority: HIGHEST for action port [ 748.045866] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea743979-0dfa-4921-a12b-5064bbda2384 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.045866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea743979-0dfa-4921-a12b-5064bbda2384" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.045866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea743979-0dfa-4921-a12b-5064bbda2384" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.045866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea743979-0dfa-4921-a12b-5064bbda2384" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.046083] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea743979-0dfa-4921-a12b-5064bbda2384',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.550152] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea743979-0dfa-4921-a12b-5064bbda2384 [ 748.551278] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.551278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.551278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.551278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.551278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.551278] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea743979-0dfa-4921-a12b-5064bbda2384 already deleted. [ 748.551609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea743979-0dfa-4921-a12b-5064bbda2384" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.774812] env[65087]: INFO networking_nsxv3.common.synchronization [None req-8f2303e3-9eb9-4055-a923-d763ea953188 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_rules [ 749.775560] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_rules [ 749.775933] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.776139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.776200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.776592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.776734] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.995411] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 749.995411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.995411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.995411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.995806] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.995806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.995806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.995970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.996023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.996176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.996239] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.293803] env[65087]: INFO networking_nsxv3.common.synchronization [None req-2a52d3c3-8e80-4015-b6ee-c11bcd0df214 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_rules [ 750.295312] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_rules [ 750.295312] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.295312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.300857] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.300857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.300857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.300857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.300857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.300857] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 already deleted. [ 750.300857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.300857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.300857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.300857] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.501842] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.502039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.502128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.502363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.502562] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.502670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.502736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.502892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.503007] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.503103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.503254] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.503426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.503504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.503636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.503822] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.503914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.503977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.505189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.505307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.505796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.505796] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.695253] env[65087]: INFO networking_nsxv3.common.synchronization [None req-e1aedd29-413e-4eef-b1c2-e00267f0f748 None None] Enqueued Resource ID: 7f4e7efa-c75f-46ca-9550-76003d777d65 with Priority: HIGHEST for action port [ 750.695253] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4e7efa-c75f-46ca-9550-76003d777d65 with Priority: HIGHEST for action port [ 750.695666] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f4e7efa-c75f-46ca-9550-76003d777d65 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.696337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f4e7efa-c75f-46ca-9550-76003d777d65" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.696531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f4e7efa-c75f-46ca-9550-76003d777d65" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.698045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f4e7efa-c75f-46ca-9550-76003d777d65" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.698045] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f4e7efa-c75f-46ca-9550-76003d777d65',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.777058] env[65087]: INFO networking_nsxv3.common.synchronization [req-01a14fb4-2585-4e7a-bce8-759fe500168c req-29a1c46e-d040-4908-ab8c-b562a2342dac tempest-MigrationsAdminTest-836415837 tempest-MigrationsAdminTest-836415837-project-member] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 750.777396] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 750.777703] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.777833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.777901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.778442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.778727] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.778858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.779579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.779806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.779940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.780523] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.823542] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.823542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.823721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.824101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.824101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.824101] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 already deleted. [ 750.824101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.010309] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0af2af-9718-4a7b-876d-92e1124cdbd2: rpc.has_security_group_logging(os_id): False [ 751.031028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.031028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.031028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.031028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.031821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.032062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.032372] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.032623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.032783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.033137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.033333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.033535] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 751.113489] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.113489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.113489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.113489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.113489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.130918] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 751.201162] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f4e7efa-c75f-46ca-9550-76003d777d65 [ 751.201162] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.201162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.201162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.201650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.201785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.201842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f4e7efa-c75f-46ca-9550-76003d777d65 already deleted. [ 751.201994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f4e7efa-c75f-46ca-9550-76003d777d65" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.282295] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.550074] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.550850] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.551085] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.551687] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.553567] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.553881] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.554124] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.554492] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.555127] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.555705] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.555993] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.556661] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.556876] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.557107] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.559018] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.559018] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.585177] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.585177] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.585177] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.585177] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.585177] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-78cf46da-1444-4083-ab7f-c9c1a656246c taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.585177] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-78cf46da-1444-4083-ab7f-c9c1a656246c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.585177] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-78cf46da-1444-4083-ab7f-c9c1a656246c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.585177] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-78cf46da-1444-4083-ab7f-c9c1a656246c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.585177] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78cf46da-1444-4083-ab7f-c9c1a656246c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.785553] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.089086] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.089317] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.089441] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.089726] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.089872] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.090038] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 78cf46da-1444-4083-ab7f-c9c1a656246c not found, creating... [ 752.090304] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.090453] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.090561] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.091344] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.091344] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.091344] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.091344] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.091612] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.091775] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.093105] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.093105] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 78cf46da-1444-4083-ab7f-c9c1a656246c is going to be created. [ 752.116590] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.116944] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.116944] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.117251] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.117455] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.117754] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-78cf46da-1444-4083-ab7f-c9c1a656246c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.289363] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.294288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.294288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.294288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.294288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.294288] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be updated. [ 752.332085] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.332825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.332825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.332825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.332825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.348577] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: IN_PROGRESS for 2s [ 752.860538] env[65087]: INFO networking_nsxv3.common.synchronization [req-01a14fb4-2585-4e7a-bce8-759fe500168c req-79d80ff8-d4cf-4b69-9686-71924522c745 service nova] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_rules [ 752.860859] env[65087]: INFO networking_nsxv3.common.synchronization [req-01a14fb4-2585-4e7a-bce8-759fe500168c req-79d80ff8-d4cf-4b69-9686-71924522c745 service nova] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 752.860859] env[65087]: INFO networking_nsxv3.common.synchronization [req-01a14fb4-2585-4e7a-bce8-759fe500168c req-79d80ff8-d4cf-4b69-9686-71924522c745 service nova] Enqueued Resource ID: 78cf46da-1444-4083-ab7f-c9c1a656246c with Priority: HIGHEST for action port [ 752.862125] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_rules [ 752.862125] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 752.862209] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78cf46da-1444-4083-ab7f-c9c1a656246c with Priority: HIGHEST for action port [ 752.862675] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.862853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.862853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.863071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.863154] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.864252] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.864252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.864463] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-78cf46da-1444-4083-ab7f-c9c1a656246c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.864463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78cf46da-1444-4083-ab7f-c9c1a656246c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.864582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78cf46da-1444-4083-ab7f-c9c1a656246c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.865885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78cf46da-1444-4083-ab7f-c9c1a656246c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.865885] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78cf46da-1444-4083-ab7f-c9c1a656246c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.150227] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 753.150227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.367134] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.367387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.370144] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78cf46da-1444-4083-ab7f-c9c1a656246c with status ACTIVE [ 753.370144] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.370144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.370144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.370144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.370144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.370144] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.370144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.370144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.370664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.370664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.370907] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.371088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.371563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.372699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.372699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.372699] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78cf46da-1444-4083-ab7f-c9c1a656246c is going to be updated. [ 753.405162] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.405162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.405162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.405162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.405162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.405162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78cf46da-1444-4083-ab7f-c9c1a656246c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.589162] env[65087]: INFO networking_nsxv3.common.synchronization [None req-9d3d2a84-e5db-48fc-b5e7-0962b6528f4a None None] Enqueued Resource ID: aa0cc653-1b43-4605-9be4-310c68f3b20d with Priority: HIGHEST for action port [ 753.589162] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0cc653-1b43-4605-9be4-310c68f3b20d with Priority: HIGHEST for action port [ 753.589162] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa0cc653-1b43-4605-9be4-310c68f3b20d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.589354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa0cc653-1b43-4605-9be4-310c68f3b20d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.589842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa0cc653-1b43-4605-9be4-310c68f3b20d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.589999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa0cc653-1b43-4605-9be4-310c68f3b20d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.590111] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa0cc653-1b43-4605-9be4-310c68f3b20d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.093444] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa0cc653-1b43-4605-9be4-310c68f3b20d [ 754.093712] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.093849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.093916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.094161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.094255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.094756] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa0cc653-1b43-4605-9be4-310c68f3b20d already deleted. [ 754.094756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa0cc653-1b43-4605-9be4-310c68f3b20d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.102972] env[65087]: INFO networking_nsxv3.common.synchronization [None req-368e347b-8d3c-4d89-b41b-503febfb878d tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_rules [ 754.103402] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_rules [ 754.103673] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.103866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.103956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.104260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.104371] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.295449] env[65087]: INFO networking_nsxv3.common.synchronization [None req-324753bb-ddd3-4187-93b0-359e7f62777c tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_rules [ 754.295449] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_rules [ 754.295929] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.296479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.365028] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: SUCCESS [ 754.365295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.365748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.365824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.365973] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.366111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.366217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.366664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.366750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.366875] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.561432] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 754.561622] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 with Priority: HIGHEST for action security_group_members [ 754.561751] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 754.562324] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 754.562514] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 with Priority: HIGHEST for action security_group_members [ 754.562514] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 754.562770] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.562920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.562976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.564112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.564303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.564411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.564478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.564678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.564852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.567047] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.568141] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.569128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.569128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.569128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.569128] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.569128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.569128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.569128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.570042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.570042] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.572355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.572355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.572355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.572355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.572579] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.572579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.572579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.572725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.573178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.573178] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.623792] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.623968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.624049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.624230] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.624306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.624408] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 already deleted. [ 754.624534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.624706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.624828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.624909] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.629230] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 with Priority: HIGHEST for action security_group_rules [ 754.629494] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 with Priority: HIGHEST for action security_group_members [ 754.629911] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_rules [ 754.630118] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 754.630298] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 754.630459] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 754.630619] env[65087]: INFO networking_nsxv3.common.synchronization [req-ff2f3ebd-427a-4d83-a523-cb7e31d4a2e5 req-9cb52ba4-8b5d-4cd6-a94c-5b85970d84fb tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with Priority: HIGHEST for action port [ 754.631161] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 with Priority: HIGHEST for action security_group_rules [ 754.631396] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_rules [ 754.631532] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 754.631657] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with Priority: HIGHEST for action port [ 754.631790] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_rules [ 754.631946] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 with Priority: HIGHEST for action security_group_members [ 754.633037] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 754.633267] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.633427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.633475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.633731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.633815] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.634690] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.636844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.636972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.637143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.637236] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.638113] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.638236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.638403] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.638556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.638592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.638740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.638819] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.639648] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.639741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.639796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.639955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.640544] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.644501] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.644661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.644901] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.644992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.869250] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.075433] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.075835] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.078579] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-b30c9113-369e-4396-b317-4f456e2038fa tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 755.078579] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.080250] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 755.080250] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.080467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.080467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.082686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.082686] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.082686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.082686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.082686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.083049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.083331] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.148088] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.148489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.148489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.148704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.148864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.148997] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 already deleted. [ 755.149118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.149501] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.149747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.149961] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 with status ACTIVE [ 755.150195] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.150340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.150450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.150743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.150885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.151137] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.151387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.151494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.151758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.151928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.152197] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.152396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.152547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.152792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.152969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.153123] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1 is going to be updated. [ 755.157232] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.157232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.157232] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.157232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.179462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.179635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.179714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.179956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.180173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.180388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be9d722-ce10-4f9d-9bf4-fbe9dda5dde1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.374797] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.492305] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-2eca3ccc-4be9-4582-a9c6-99b1e9141936 tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 755.492411] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 755.492751] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.492891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.579920] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.580991] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.584958] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.589131] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.589131] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.589131] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f already deleted. [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.589131] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.589131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.589982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.589982] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.813614] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-5e938d9f-a11f-435f-9322-15c3cae40071 tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 755.813797] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 755.814188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.814316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.879967] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.880178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.880247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.880437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.880530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.880624] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be updated. [ 755.924555] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.924555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.924555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.924555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.924555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.939090] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: IN_PROGRESS for 2s [ 756.084693] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.085095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.087189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.087189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.087189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.087189] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 is going to be created. [ 756.087189] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.087564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.087564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.087564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.087666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.087694] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 756.089456] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.089906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.090044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.090261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.090393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.090673] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba is going to be updated. [ 756.093565] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.093754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.093940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.094170] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.094540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.094785] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.094939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.095050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.095490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.095617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.095763] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f already deleted. [ 756.095894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.097490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.097728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.098039] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.098520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.098520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.098960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.099118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.099249] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.132248] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.132248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.132433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.132568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.132800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.147530] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.147530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.147530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.147530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.147530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.151488] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.151831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.151831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.151915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.152062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.159753] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 756.160665] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 in Status: UNINITIALIZED for 2s [ 756.169072] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: IN_PROGRESS for 2s [ 756.197592] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.197807] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-411" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.197946] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-411" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.198321] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-411" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.198584] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.198739] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.198848] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.199071] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.199205] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.199432] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.199526] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.199633] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.199733] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.199834] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 756.199932] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.200072] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.221561] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.221871] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 756.222012] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.222289] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-411" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.223048] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-742622f8-72ff-407a-95b9-718a5c5cdc0f taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.223219] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-742622f8-72ff-407a-95b9-718a5c5cdc0f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.223375] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-742622f8-72ff-407a-95b9-718a5c5cdc0f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.223879] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-742622f8-72ff-407a-95b9-718a5c5cdc0f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.224473] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('742622f8-72ff-407a-95b9-718a5c5cdc0f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.509463] env[65087]: INFO networking_nsxv3.common.synchronization [None req-cf981a27-9840-4926-8d67-f1ebc066876c None None] Enqueued Resource ID: 89641870-9cd2-4b61-bac9-028bb2bc8400 with Priority: HIGHEST for action port [ 756.510038] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89641870-9cd2-4b61-bac9-028bb2bc8400 with Priority: HIGHEST for action port [ 756.510292] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-89641870-9cd2-4b61-bac9-028bb2bc8400 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.510443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89641870-9cd2-4b61-bac9-028bb2bc8400" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.510537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89641870-9cd2-4b61-bac9-028bb2bc8400" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.510813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89641870-9cd2-4b61-bac9-028bb2bc8400" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.510921] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89641870-9cd2-4b61-bac9-028bb2bc8400',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.601495] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.601706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.601706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.601925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.602033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.602233] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.602347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.602390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.602575] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.602653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.602700] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f already deleted. [ 756.602781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.726883] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.727150] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.727275] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.727549] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.727694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.727877] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 742622f8-72ff-407a-95b9-718a5c5cdc0f not found, creating... [ 756.728173] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.728344] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.728495] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.728971] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.728971] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.729302] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.729647] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.729851] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.730201] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.730401] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.730577] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 742622f8-72ff-407a-95b9-718a5c5cdc0f is going to be created. [ 756.752136] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.752369] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.752516] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.752802] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.753048] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.753269] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-742622f8-72ff-407a-95b9-718a5c5cdc0f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.013029] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89641870-9cd2-4b61-bac9-028bb2bc8400 [ 757.014710] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.014710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.014710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.014710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.014710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.014710] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89641870-9cd2-4b61-bac9-028bb2bc8400 already deleted. [ 757.014710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89641870-9cd2-4b61-bac9-028bb2bc8400" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.301176] env[65087]: INFO networking_nsxv3.common.synchronization [req-c9469d30-e1b7-4139-a17f-0ccb6240510e req-da612039-5824-4eb1-b266-546c2108521a tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 757.301695] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 757.302134] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.302309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.302309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.302495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.302766] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.302766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.302912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.302994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.303119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.303202] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.327929] env[65087]: INFO networking_nsxv3.common.synchronization [req-c9469d30-e1b7-4139-a17f-0ccb6240510e req-da612039-5824-4eb1-b266-546c2108521a tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 757.328141] env[65087]: INFO networking_nsxv3.common.synchronization [req-c9469d30-e1b7-4139-a17f-0ccb6240510e req-da612039-5824-4eb1-b266-546c2108521a tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 757.328278] env[65087]: INFO networking_nsxv3.common.synchronization [req-c9469d30-e1b7-4139-a17f-0ccb6240510e req-da612039-5824-4eb1-b266-546c2108521a tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: 226d90d4-6acd-461c-91eb-55fea113ddaf with Priority: HIGHEST for action port [ 757.328762] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 757.330650] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 757.330650] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 226d90d4-6acd-461c-91eb-55fea113ddaf with Priority: HIGHEST for action port [ 757.330650] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.330650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.330650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.330650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.330650] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.331131] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.331131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.331131] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-226d90d4-6acd-461c-91eb-55fea113ddaf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.331260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.331378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.331719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.331719] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226d90d4-6acd-461c-91eb-55fea113ddaf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.527671] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-521538a0-7cb2-4d1a-a5c9-2a06e5ec3155 service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 757.527671] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-521538a0-7cb2-4d1a-a5c9-2a06e5ec3155 service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 757.527671] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-521538a0-7cb2-4d1a-a5c9-2a06e5ec3155 service nova] Enqueued Resource ID: 742622f8-72ff-407a-95b9-718a5c5cdc0f with Priority: HIGHEST for action port [ 757.527965] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 757.529422] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 757.529422] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 742622f8-72ff-407a-95b9-718a5c5cdc0f with Priority: HIGHEST for action port [ 757.529422] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.529422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.529422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.529422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.529422] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.530442] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.530604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.530649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.530883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.531089] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.531281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.531402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.531638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.531762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.531910] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.533194] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-742622f8-72ff-407a-95b9-718a5c5cdc0f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.533592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-742622f8-72ff-407a-95b9-718a5c5cdc0f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.533592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-742622f8-72ff-407a-95b9-718a5c5cdc0f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.533749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-742622f8-72ff-407a-95b9-718a5c5cdc0f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.533904] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('742622f8-72ff-407a-95b9-718a5c5cdc0f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.809457] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.834064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.834250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.834452] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 226d90d4-6acd-461c-91eb-55fea113ddaf with status ACTIVE [ 757.834648] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.834774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.834812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.835029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.835125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.835275] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.835371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.835420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.835563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.835636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.836749] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.836749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.836749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.836749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.836749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.836749] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 226d90d4-6acd-461c-91eb-55fea113ddaf is going to be updated. [ 757.864685] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.864685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.864685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.864685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.864685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.864685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.870260] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7752ed5-2b7d-4764-b90b-6c483f394291 req-162786c9-a949-4983-b3a7-a4ea9e246482 tempest-AttachVolumeShelveTestJSON-1249647460 tempest-AttachVolumeShelveTestJSON-1249647460-project-member] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_members [ 757.870961] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_members [ 757.871954] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.872246] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.872487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.872829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.873101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.873318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.873480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.873722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.873889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.874068] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.955115] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: SUCCESS [ 757.955394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.955592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.955834] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.956109] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.956283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.956384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.956611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.956759] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.956876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.956997] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.036096] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.036976] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.037750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.038222] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 742622f8-72ff-407a-95b9-718a5c5cdc0f with status ACTIVE [ 758.038429] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.038552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.038615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.038817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.038909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.039355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.039473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.039654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.039846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.040058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.040353] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.040473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.040538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.040785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.040866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.040952] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 742622f8-72ff-407a-95b9-718a5c5cdc0f is going to be updated. [ 758.065940] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.066145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.066304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.066441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.066600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.066782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-742622f8-72ff-407a-95b9-718a5c5cdc0f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.175062] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 in Status: SUCCESS [ 758.175299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.176411] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 758.176411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.176608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.176898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.176898] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.177074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.177165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.177793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.177793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.177793] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.178593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.178838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.178921] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.179325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.179325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.179325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.179454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.179488] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.190120] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: SUCCESS [ 758.190120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.190120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.190120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.190395] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.190460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.190569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.190939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.190939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.191101] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.309379] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.377491] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.378464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.378464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.378464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.378464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.378464] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.378464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.378464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.378730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.378730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.378730] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ae9556d-2824-4426-9646-69904ca4036b already deleted. [ 758.378816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.460378] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.460553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.460652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.461068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.461068] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.461068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.461412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.461412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.461412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.461571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.461624] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.461695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.461742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.461984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.461984] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.462168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.462168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.462370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.462370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.462472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.462521] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.475118] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.475857] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.475857] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.475958] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.476408] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.476572] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.476696] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.476943] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.477111] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.477319] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.477440] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.477572] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.477668] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.477785] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.477903] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.478106] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.498983] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.499202] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.499390] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.499591] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.499918] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-e6af5536-4390-40ae-bef6-ddd069231d96 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.500124] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.500399] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.500623] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.500937] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6af5536-4390-40ae-bef6-ddd069231d96',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.527058] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-47 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.527277] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-47" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.527380] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-47" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.527734] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-47" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.527992] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.528161] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.528271] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.528511] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.528776] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.529025] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.529139] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.529667] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.529881] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.529965] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.530021] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.530153] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.538596] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.548518] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.548518] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.548749] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.548749] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-47" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.549983] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-967298df-a15d-41ae-a071-4e5787320858 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.549983] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-967298df-a15d-41ae-a071-4e5787320858" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.549983] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-967298df-a15d-41ae-a071-4e5787320858" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.549983] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-967298df-a15d-41ae-a071-4e5787320858" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.549983] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967298df-a15d-41ae-a071-4e5787320858',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.681477] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.682451] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.696569] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.812489] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.812644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.812681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.812883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.812973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.813089] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be updated. [ 758.859544] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.859742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.859783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.859983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.860175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.870887] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: IN_PROGRESS for 2s [ 758.969573] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d32cda0b-8a2f-42b1-8b70-9028c276b777: rpc.has_security_group_logging(os_id): False [ 758.971352] env[65087]: INFO networking_nsxv3.common.synchronization [None req-0939741a-d05a-4b96-8693-17bb76c5ecc0 None None] Enqueued Resource ID: ee6b8739-5a17-4c78-8042-82322f2d7579 with Priority: HIGHEST for action port [ 758.971964] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee6b8739-5a17-4c78-8042-82322f2d7579 with Priority: HIGHEST for action port [ 758.972662] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee6b8739-5a17-4c78-8042-82322f2d7579 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.972772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee6b8739-5a17-4c78-8042-82322f2d7579" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.972831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee6b8739-5a17-4c78-8042-82322f2d7579" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.973079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee6b8739-5a17-4c78-8042-82322f2d7579" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.973164] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee6b8739-5a17-4c78-8042-82322f2d7579',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.992430] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.992622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.992622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.993032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.003919] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.003919] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.004173] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.004388] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.004589] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.004763] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port e6af5536-4390-40ae-bef6-ddd069231d96 not found, creating... [ 759.005116] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.005312] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.005437] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.005687] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.005826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.006660] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.006843] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.006958] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.007204] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.007454] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.007531] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: e6af5536-4390-40ae-bef6-ddd069231d96 is going to be created. [ 759.021721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.022049] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.022177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.022247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.022455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.022543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.022761] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.022863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.022928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.023097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.023176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.023354] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.023526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.023581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.023726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.023801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.023904] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be updated. [ 759.035072] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.035072] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.035072] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.035072] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.035072] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.035072] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.041484] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.041484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.041484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.041484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.041484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.041484] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be created. [ 759.053192] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.053192] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.053192] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.053192] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.053192] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.053518] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 967298df-a15d-41ae-a071-4e5787320858 not found, creating... [ 759.053584] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.053710] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.053830] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.054070] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.054253] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.054549] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.054702] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.054839] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.055079] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.055213] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.055353] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 967298df-a15d-41ae-a071-4e5787320858 is going to be created. [ 759.077458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.077725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.077725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.077888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.077974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.086952] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.086952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.086952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.087294] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.087427] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.087644] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-967298df-a15d-41ae-a071-4e5787320858" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.092288] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: UNINITIALIZED for 2s [ 759.122266] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.122346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.122346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.122556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.122708] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.158840] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: IN_PROGRESS for 2s [ 759.184500] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.185814] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.198903] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.475736] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee6b8739-5a17-4c78-8042-82322f2d7579 [ 759.475736] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.475736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.475736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.476096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.476096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.476096] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee6b8739-5a17-4c78-8042-82322f2d7579 already deleted. [ 759.476096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee6b8739-5a17-4c78-8042-82322f2d7579" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.687602] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.687820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.687820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.688124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.688169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.688248] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 is going to be updated. [ 759.689591] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.689726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.689862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.689976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.690057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.690139] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 759.701776] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.701776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.701776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.701964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.702052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.702257] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba is going to be updated. [ 759.725282] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.725282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.725282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.725282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.725282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.725282] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.725282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.725282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.725780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.725829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.729019] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7752ed5-2b7d-4764-b90b-6c483f394291 req-0cae0899-7137-4c96-8e72-9b015aefcc7b service nova] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_rules [ 759.729296] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7752ed5-2b7d-4764-b90b-6c483f394291 req-0cae0899-7137-4c96-8e72-9b015aefcc7b service nova] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_members [ 759.729543] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7752ed5-2b7d-4764-b90b-6c483f394291 req-0cae0899-7137-4c96-8e72-9b015aefcc7b service nova] Enqueued Resource ID: e6af5536-4390-40ae-bef6-ddd069231d96 with Priority: HIGHEST for action port [ 759.730030] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_rules [ 759.730164] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_members [ 759.730270] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6af5536-4390-40ae-bef6-ddd069231d96 with Priority: HIGHEST for action port [ 759.730580] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.730723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.730821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.731217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.731217] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.732455] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.732455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.732455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.732455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.732724] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.732796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.732851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.737024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.737024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.737024] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.737024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6af5536-4390-40ae-bef6-ddd069231d96 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.737024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.737024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.737024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.737024] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6af5536-4390-40ae-bef6-ddd069231d96',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.737024] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 in Status: IN_PROGRESS for 2s [ 759.737738] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 759.738512] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.738859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.738859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.738968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.739106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.746984] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: IN_PROGRESS for 2s [ 759.771097] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-9f3323e5-cbb0-4f53-89f1-ea3c5445f07d service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 759.771277] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-9f3323e5-cbb0-4f53-89f1-ea3c5445f07d service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 759.771419] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-9f3323e5-cbb0-4f53-89f1-ea3c5445f07d service nova] Enqueued Resource ID: 967298df-a15d-41ae-a071-4e5787320858 with Priority: HIGHEST for action port [ 759.771880] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 759.772342] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 759.772705] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 967298df-a15d-41ae-a071-4e5787320858 with Priority: HIGHEST for action port [ 759.773125] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.773273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.773582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.773705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.773927] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-967298df-a15d-41ae-a071-4e5787320858 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.774533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-967298df-a15d-41ae-a071-4e5787320858" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.774533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-967298df-a15d-41ae-a071-4e5787320858" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.774533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-967298df-a15d-41ae-a071-4e5787320858" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.774677] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('967298df-a15d-41ae-a071-4e5787320858',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.236933] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.238481] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.238649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.239731] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6af5536-4390-40ae-bef6-ddd069231d96 with status ACTIVE [ 760.239731] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.239731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.239731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.239731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.239731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.239996] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.239996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.241020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.241020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.241020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.241020] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.241698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.242027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.242309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.242493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.242630] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6af5536-4390-40ae-bef6-ddd069231d96 is going to be updated. [ 760.268327] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.268918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.268918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.268918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.269672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.269672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.279911] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 967298df-a15d-41ae-a071-4e5787320858 with status ACTIVE [ 760.279911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.279911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.279911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.279911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.279911] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 967298df-a15d-41ae-a071-4e5787320858 is going to be updated. [ 760.333052] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.334765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.334765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.334765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.334765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.334765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-967298df-a15d-41ae-a071-4e5787320858" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.620164] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.620550] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-411" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.620608] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-411" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.620928] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-411" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.621312] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.621497] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.621617] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.621836] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.622075] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.622401] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.622595] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.622780] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.622982] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.623130] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.623289] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.623490] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.646365] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.646548] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.646664] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.646837] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-411" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.647188] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.647364] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.647469] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.647791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.647922] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6fa9e6a-dba0-413c-a6d5-da39e75a0b96',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.745317] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.764501] env[65087]: INFO networking_nsxv3.common.synchronization [req-1192d33c-26dd-4239-b4e5-4dfbdcece6b6 req-9809b164-31a6-4cfc-bbac-d701b962f9c5 tempest-ServersNegativeTestJSON-734531957 tempest-ServersNegativeTestJSON-734531957-project-member] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 760.765072] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 760.765388] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.765495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.765591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.765812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.765967] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.766215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.766289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.766453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.766542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.766633] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.881483] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 760.881784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.881892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.882228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.882368] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.882499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.882556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.882723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.882806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.882906] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.102581] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 761.102798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.102960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.103187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.103377] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.103547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.103611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.103758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.103838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.103947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.104044] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.104976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.105136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.105314] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.105434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.105499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.105638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.105760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.105824] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.150900] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.151414] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.151414] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.151808] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.152129] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.152565] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port a6fa9e6a-dba0-413c-a6d5-da39e75a0b96 not found, creating... [ 761.152729] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.153291] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.153291] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.153291] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.153546] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.153893] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.154114] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.154618] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.154618] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.154721] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.154874] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: a6fa9e6a-dba0-413c-a6d5-da39e75a0b96 is going to be created. [ 761.176305] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: SUCCESS [ 761.176573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.183246] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.183539] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.183751] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.184031] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.184282] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.184579] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.202464] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-329 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.202967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.202967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.203216] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.203545] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.203737] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.203892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.204175] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.204349] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.204604] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.204721] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.204853] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.205017] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.205157] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.205296] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.205435] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.225606] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.225897] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.226084] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.226283] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.226614] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-aff05726-4c68-42cd-8887-b24f418b689d taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.226822] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.226946] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.227309] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.227453] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aff05726-4c68-42cd-8887-b24f418b689d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.247912] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.248105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.248168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.248392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.248485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.248590] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ae9556d-2824-4426-9646-69904ca4036b is going to be created. [ 761.268500] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.268664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.268854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.269326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.269326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.269326] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.269326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.269530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.269530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.269617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.269665] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 already deleted. [ 761.270077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.274379] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.274508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.274569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.274741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.274897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.285798] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: UNINITIALIZED for 2s [ 761.385484] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.608293] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.609716] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.609851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.730502] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.730824] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.730862] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.731154] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.731300] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.731454] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port aff05726-4c68-42cd-8887-b24f418b689d not found, creating... [ 761.731721] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.731873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.731984] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.732216] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.732349] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.732619] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.732801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.732985] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.733209] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.733339] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.733495] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: aff05726-4c68-42cd-8887-b24f418b689d is going to be created. [ 761.747466] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 in Status: SUCCESS [ 761.747630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.748795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.749009] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.749201] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.749315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.749380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.749531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.749614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.749698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.749789] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.751567] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 761.751741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.751896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.752079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.752251] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.752360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.752424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.752571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.752649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.752733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.752820] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.755881] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.756069] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.756228] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.756573] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.756621] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.756793] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.763601] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: SUCCESS [ 761.763916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.764009] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.764171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.764310] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.764422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.764487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.764633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.764712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.764795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.764883] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.886492] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-f764238c-f628-4c1d-8e76-c45c1ecb7eab service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 761.886681] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-f764238c-f628-4c1d-8e76-c45c1ecb7eab service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 761.886879] env[65087]: INFO networking_nsxv3.common.synchronization [req-8ef7b975-df3c-40de-8087-162e555de236 req-f764238c-f628-4c1d-8e76-c45c1ecb7eab service nova] Enqueued Resource ID: a6fa9e6a-dba0-413c-a6d5-da39e75a0b96 with Priority: HIGHEST for action port [ 761.887486] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 761.887631] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 761.887789] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6fa9e6a-dba0-413c-a6d5-da39e75a0b96 with Priority: HIGHEST for action port [ 761.887939] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.889044] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.889044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.889216] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.889260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.889403] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.889503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.889638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.889789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.889823] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6fa9e6a-dba0-413c-a6d5-da39e75a0b96',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.111941] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.254778] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.256071] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.256071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.256071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.257203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.257203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.257203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.257203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.257203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.257203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.257203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.257203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.257203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.257203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.257734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.257734] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.257734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.257734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.257954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.257954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.258056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.258103] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.267664] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.391337] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.391533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.391612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.391911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.392117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.392117] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be updated. [ 762.393473] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6fa9e6a-dba0-413c-a6d5-da39e75a0b96 with status ACTIVE [ 762.393619] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.393731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.393801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.394181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.394181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.394259] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.394358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.394358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.394553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.394617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.394758] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.394852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.394915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.395057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.395132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.395579] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6fa9e6a-dba0-413c-a6d5-da39e75a0b96 is going to be updated. [ 762.417841] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.417996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.418085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.418499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.418658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.418832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6fa9e6a-dba0-413c-a6d5-da39e75a0b96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.423866] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.423866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.424060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.424508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.424508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.432554] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: IN_PROGRESS for 2s [ 762.515081] env[65087]: INFO networking_nsxv3.common.synchronization [req-1192d33c-26dd-4239-b4e5-4dfbdcece6b6 req-6c0e7a23-45ce-4fab-aaa2-1f44f0c8abd5 service nova] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_rules [ 762.515081] env[65087]: INFO networking_nsxv3.common.synchronization [req-1192d33c-26dd-4239-b4e5-4dfbdcece6b6 req-6c0e7a23-45ce-4fab-aaa2-1f44f0c8abd5 service nova] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 762.515081] env[65087]: INFO networking_nsxv3.common.synchronization [req-1192d33c-26dd-4239-b4e5-4dfbdcece6b6 req-6c0e7a23-45ce-4fab-aaa2-1f44f0c8abd5 service nova] Enqueued Resource ID: aff05726-4c68-42cd-8887-b24f418b689d with Priority: HIGHEST for action port [ 762.516447] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_rules [ 762.516447] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 762.516447] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aff05726-4c68-42cd-8887-b24f418b689d with Priority: HIGHEST for action port [ 762.516447] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.516447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.516447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.516813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.516813] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.517627] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.517795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.517875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.518087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.518243] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.518380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.518457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.518622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.518744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.518883] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.520230] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-aff05726-4c68-42cd-8887-b24f418b689d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.520387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.520493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.520672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.520806] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aff05726-4c68-42cd-8887-b24f418b689d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.617123] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.617123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.617123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.617123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.617123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.617123] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 762.649238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.650072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.650072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.650072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.650072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.661635] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 762.759736] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5fd4ec2-d6c3-4894-bd80-751b7e6176d6: rpc.has_security_group_logging(os_id): False [ 762.760926] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3c0a5a-197c-4c4c-a82b-9342302fe922: rpc.has_security_group_logging(os_id): False [ 762.769622] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a6dd9b03-d553-4b7a-b9f5-f9e3b715daba: rpc.has_security_group_logging(os_id): False [ 762.777618] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.777781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.777826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.778045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.778156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.778362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.778468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.778532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.778696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.778769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.779145] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.779145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.779145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.779307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.779343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.779536] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.779963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.779963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.779963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.779963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.779963] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 762.783581] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.783581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.783581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.783581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.783581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.785723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.785842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.785910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.786151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.786234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.786317] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 is going to be created. [ 762.789045] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.789166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.789235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.789391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.789472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.789673] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.789771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.789833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.790088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.790234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.790323] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba is going to be updated. [ 762.852670] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.852670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.852805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.852958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.853577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.855015] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.855218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.855218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.855368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.855502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.857675] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.857787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.857879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.858043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.858175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.869448] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 in Status: IN_PROGRESS for 2s [ 762.873113] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: IN_PROGRESS for 2s [ 762.876264] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 763.023326] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.024026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.024026] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.024606] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aff05726-4c68-42cd-8887-b24f418b689d with status ACTIVE [ 763.024799] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.024910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.025679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.025679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.025679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.025679] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.025679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.025679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.025944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.030552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.030931] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.031069] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.031141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.031395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.031525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.031671] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aff05726-4c68-42cd-8887-b24f418b689d is going to be updated. [ 763.054217] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.054217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.054217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.054217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.054217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.054217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.307972] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: SUCCESS [ 763.308155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.308314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.308542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.308731] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.308854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.308921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.309102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.309186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.309274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.309367] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.361418] env[65087]: INFO networking_nsxv3.common.synchronization [None req-16dd4e3d-1a49-4b1c-99df-b0ef9d5a67ee tempest-ServersTestBootFromVolume-901464301 tempest-ServersTestBootFromVolume-901464301-project-member] Enqueued Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_rules [ 763.362412] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_rules [ 763.362723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.362891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.362987] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.363282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.363399] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.377370] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc01db64-9037-4a91-9b34-b756e3214dda req-031f4405-f713-484f-8b9f-3381697909e4 tempest-ServersAdminTestJSON-1882897549 tempest-ServersAdminTestJSON-1882897549-project-member] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 763.377877] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 763.378228] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.378375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.378622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.378709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.378960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.379102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.379192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.379350] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.379449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.379603] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.530821] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5d4e2df8-8d71-4b0b-a23f-9ceb633af01e tempest-ServersTestBootFromVolume-901464301 tempest-ServersTestBootFromVolume-901464301-project-member] Enqueued Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_rules [ 763.530821] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_rules [ 763.530821] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.530821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.533881] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.797974] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.798305] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.798419] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.798862] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.799186] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.799317] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.799636] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.799714] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.799792] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.799992] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.800150] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.800247] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.800380] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.800745] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.800745] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.800745] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.812955] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.827170] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.827344] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.827480] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.827648] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.827961] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-5cea6697-ddc3-4213-b965-bd9ae6227acf taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.828148] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-5cea6697-ddc3-4213-b965-bd9ae6227acf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.828264] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-5cea6697-ddc3-4213-b965-bd9ae6227acf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.828589] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-5cea6697-ddc3-4213-b965-bd9ae6227acf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.828727] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cea6697-ddc3-4213-b965-bd9ae6227acf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.882262] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.888887] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.889054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.889153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.889536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.889536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.889536] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 already deleted. [ 763.889768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.889768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.889901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.890653] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.037159] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.037326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.037364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.037554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.037648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.037749] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be created. [ 764.062965] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.063216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.063296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.063610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.063818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.078418] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: UNINITIALIZED for 2s [ 764.318108] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ae9556d-2824-4426-9646-69904ca4036b: rpc.has_security_group_logging(os_id): False [ 764.332389] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.332389] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.332389] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.333081] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.333081] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.333081] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 5cea6697-ddc3-4213-b965-bd9ae6227acf not found, creating... [ 764.333491] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.334498] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.334498] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.334498] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.334498] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.334498] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.335821] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.335821] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.335821] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.335821] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.335821] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 5cea6697-ddc3-4213-b965-bd9ae6227acf is going to be created. [ 764.353687] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.353687] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.353880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.354754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.354754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.354754] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.354988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.354988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.355242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.355357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.355465] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ae9556d-2824-4426-9646-69904ca4036b is going to be created. [ 764.378158] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.378158] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.378338] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.379496] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.379496] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.379756] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-5cea6697-ddc3-4213-b965-bd9ae6227acf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.384760] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.415582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.415668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.415741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.415962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.416078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.416178] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 already deleted. [ 764.416260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.432518] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.432518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.432518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.432518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.432518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.451590] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 764.451590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.451590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.451590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.451590] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.451590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.451590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.451590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.451590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.451590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.451590] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.465733] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: IN_PROGRESS for 2s [ 764.675401] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 764.676229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.679071] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.679071] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.679071] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.679071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.679695] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.682211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.682954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.682954] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.682954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.682954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.682954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.682954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.685257] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.886013] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 in Status: SUCCESS [ 764.886362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.890803] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.890803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.890803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.890803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.890803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.890803] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 764.901471] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: SUCCESS [ 764.901471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.908269] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 764.908269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.933200] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.933200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.933200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.933950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.935273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.954925] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.958229] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 765.181037] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc01db64-9037-4a91-9b34-b756e3214dda req-f7864e19-3e96-4cb2-a1cb-76760eec39ef service nova] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_rules [ 765.181244] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc01db64-9037-4a91-9b34-b756e3214dda req-f7864e19-3e96-4cb2-a1cb-76760eec39ef service nova] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 765.181448] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc01db64-9037-4a91-9b34-b756e3214dda req-f7864e19-3e96-4cb2-a1cb-76760eec39ef service nova] Enqueued Resource ID: 5cea6697-ddc3-4213-b965-bd9ae6227acf with Priority: HIGHEST for action port [ 765.181926] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_rules [ 765.182076] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 765.182193] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cea6697-ddc3-4213-b965-bd9ae6227acf with Priority: HIGHEST for action port [ 765.182602] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.182678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.182742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.183566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.183566] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.184028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.184184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.185414] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cea6697-ddc3-4213-b965-bd9ae6227acf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.185414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cea6697-ddc3-4213-b965-bd9ae6227acf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.185414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cea6697-ddc3-4213-b965-bd9ae6227acf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.185414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cea6697-ddc3-4213-b965-bd9ae6227acf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.185414] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cea6697-ddc3-4213-b965-bd9ae6227acf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.186215] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e56f2582-99a0-4048-840f-b0950b64562f: rpc.has_security_group_logging(os_id): False [ 765.187332] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.208951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.209172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.209240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.209405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.209493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.209846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.209846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.209979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.210032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.210103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.210291] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.210414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.210469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.211148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.211148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.211148] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.211148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.211148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.211148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.211423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.211423] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be created. [ 765.279795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.280659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.280659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.280659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.280659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.316502] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 765.457241] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68: rpc.has_security_group_logging(os_id): False [ 765.477556] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.477750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.477750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.477979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.509113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.509468] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.509599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.509719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.509885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.509973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.510115] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be updated. [ 765.602063] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.602270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.602347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.602874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.603084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.616733] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: IN_PROGRESS for 2s [ 765.687507] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.687746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.689203] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cea6697-ddc3-4213-b965-bd9ae6227acf with status ACTIVE [ 765.689461] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.689622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.689714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.689993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.690129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.690363] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.690500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.690581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.690782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.690887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.691144] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.691272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.691563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.691563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.691711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.691806] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cea6697-ddc3-4213-b965-bd9ae6227acf is going to be updated. [ 765.696813] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.729919] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.729919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.730195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.730314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.730522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.730729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cea6697-ddc3-4213-b965-bd9ae6227acf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.895360] env[65087]: INFO networking_nsxv3.common.synchronization [req-b147ae43-027e-49dd-a2b9-b057df0871f5 req-fa6a31c9-ca8f-4686-8f19-59134f54dd81 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 765.895679] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 765.895842] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.895983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.896410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.900081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.900081] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.900081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.900081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.900081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.900081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.900081] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.091085] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 766.091085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.091779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.091779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.092081] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.092313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.092470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.092759] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.092912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.093082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.093381] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.178312] env[65087]: INFO networking_nsxv3.common.synchronization [req-9d3af889-d353-4697-8596-701756c2e282 req-f9e7f31a-0b71-429b-8d7d-da756ab96244 tempest-AttachInterfacesV270Test-459864844 tempest-AttachInterfacesV270Test-459864844-project-member] Enqueued Resource ID: 082fc1a8-0a58-4162-926b-fe01957908a7 with Priority: HIGHEST for action security_group_members [ 766.179958] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082fc1a8-0a58-4162-926b-fe01957908a7 with Priority: HIGHEST for action security_group_members [ 766.179958] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-082fc1a8-0a58-4162-926b-fe01957908a7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.180682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.180845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.181175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.181488] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.182013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.182013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.182113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.182216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.182367] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('082fc1a8-0a58-4162-926b-fe01957908a7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.198682] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.198682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.201155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.201155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.201155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.201155] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 766.241309] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.241636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.241636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.241852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.241933] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.255158] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 766.404257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.404257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.404257] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 already deleted. [ 766.404257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.457219] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.457673] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.458039] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.458444] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.459410] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.459790] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.460062] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.460655] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.460990] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.463128] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.463128] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.463128] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.463128] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.463128] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.463128] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.463128] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.484297] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: SUCCESS [ 766.484297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.492039] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.492039] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.492039] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.492039] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.492039] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-f11395bc-ee0f-4b83-b013-fde9d4a22269 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.492039] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-f11395bc-ee0f-4b83-b013-fde9d4a22269" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.492039] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-f11395bc-ee0f-4b83-b013-fde9d4a22269" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.492039] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-f11395bc-ee0f-4b83-b013-fde9d4a22269" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.492039] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f11395bc-ee0f-4b83-b013-fde9d4a22269',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.598404] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.598404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.598404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.598404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.598404] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.598404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.598404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.598404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.603273] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.603273] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.603273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.603273] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.685426] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.685757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.685862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.688731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.688731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.688731] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.688731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.688731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.688731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.688731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.688731] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 082fc1a8-0a58-4162-926b-fe01957908a7 is going to be updated. [ 766.725588] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.725871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.725984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.726229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.726442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.740918] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082fc1a8-0a58-4162-926b-fe01957908a7 in Status: IN_PROGRESS for 2s [ 766.972955] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 766.972955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.972955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.972955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.972955] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.972955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.972955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.972955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.972955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.972955] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.997333] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.997333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.997333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.997333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.997333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.997333] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port f11395bc-ee0f-4b83-b013-fde9d4a22269 not found, creating... [ 766.997333] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.997333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.997333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.997333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.997333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.997972] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.997972] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.998337] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.998764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.999055] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.999310] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: f11395bc-ee0f-4b83-b013-fde9d4a22269 is going to be created. [ 767.025040] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.025399] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.025609] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.026031] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.026329] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.026596] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-f11395bc-ee0f-4b83-b013-fde9d4a22269" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.104726] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa843f83-ade7-475f-9e86-d1f12b4e1f38: rpc.has_security_group_logging(os_id): False [ 767.136701] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.136846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.136947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.137243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.137339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.137754] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.137856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.137922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.138114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.138198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.138397] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.138498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.138564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.138726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.138799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.138990] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.139095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.139191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.139308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.139381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.139470] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be created. [ 767.169595] env[65087]: INFO networking_nsxv3.common.synchronization [req-8bf5c3f7-020c-4853-b71e-0578369d19cb req-a85bb33e-d69c-48e7-a784-9cefa4b86acc tempest-FloatingIPsAssociationTestJSON-1186937205 tempest-FloatingIPsAssociationTestJSON-1186937205-project-member] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 767.170290] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 767.171128] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.171128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.171128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.171728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.171935] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.172394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.172394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.172593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.173146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.173233] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.204422] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.204647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.204700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.204924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.205163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.218881] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: IN_PROGRESS for 2s [ 767.289792] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:0 completed [ 767.289987] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:1 started [ 767.337567] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 767.337946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.338276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.339791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.339791] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.476366] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.534272] env[65087]: INFO networking_nsxv3.common.synchronization [req-f9b29df5-dd40-49c6-8c70-82aff20fd9af req-713bc995-6446-47f2-a74c-bd80b9e6521c tempest-ServersAdminNegativeTestJSON-2073613632 tempest-ServersAdminNegativeTestJSON-2073613632-project-member] Enqueued Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 767.535600] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 767.535600] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.535600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.535928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.535928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.537657] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.537657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.537657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.537657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.537657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.537657] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.633545] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 767.633854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.676311] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.783309] env[65087]: INFO networking_nsxv3.common.synchronization [req-b147ae43-027e-49dd-a2b9-b057df0871f5 req-c1862bfa-9d7c-44a3-b7da-bd80c08d78f9 service nova] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_rules [ 767.783309] env[65087]: INFO networking_nsxv3.common.synchronization [req-b147ae43-027e-49dd-a2b9-b057df0871f5 req-c1862bfa-9d7c-44a3-b7da-bd80c08d78f9 service nova] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 767.783309] env[65087]: INFO networking_nsxv3.common.synchronization [req-b147ae43-027e-49dd-a2b9-b057df0871f5 req-c1862bfa-9d7c-44a3-b7da-bd80c08d78f9 service nova] Enqueued Resource ID: f11395bc-ee0f-4b83-b013-fde9d4a22269 with Priority: HIGHEST for action port [ 767.783531] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_rules [ 767.783651] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 767.783764] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f11395bc-ee0f-4b83-b013-fde9d4a22269 with Priority: HIGHEST for action port [ 767.784140] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.784227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.784277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.784533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.784620] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.785495] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.785609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.785674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.785959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.786051] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.787404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.787404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.787404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.787404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.787404] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.788287] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f11395bc-ee0f-4b83-b013-fde9d4a22269 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.788287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f11395bc-ee0f-4b83-b013-fde9d4a22269" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.788287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f11395bc-ee0f-4b83-b013-fde9d4a22269" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.789923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f11395bc-ee0f-4b83-b013-fde9d4a22269" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.789923] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f11395bc-ee0f-4b83-b013-fde9d4a22269',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.842261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.842379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.979562] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.997691] env[65087]: INFO networking_nsxv3.common.synchronization [req-dd0f0e93-f6b4-4e9d-876a-6fd73f7d7d5d req-b40f8e60-8d37-4a86-94be-27dbd798cafd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 767.998088] env[65087]: INFO networking_nsxv3.common.synchronization [req-dd0f0e93-f6b4-4e9d-876a-6fd73f7d7d5d req-b40f8e60-8d37-4a86-94be-27dbd798cafd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 with Priority: HIGHEST for action security_group_members [ 767.998279] env[65087]: INFO networking_nsxv3.common.synchronization [req-dd0f0e93-f6b4-4e9d-876a-6fd73f7d7d5d req-b40f8e60-8d37-4a86-94be-27dbd798cafd tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 768.000053] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 768.000242] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 with Priority: HIGHEST for action security_group_members [ 768.000334] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba with Priority: HIGHEST for action security_group_members [ 768.000797] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.001153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.001851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.002194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.002724] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.003903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.004532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.004794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.004964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.005092] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.006330] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.006771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.007505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.007965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.008297] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.008505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.008643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.009127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.009127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.009288] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5fd4ec2-d6c3-4894-bd80-751b7e6176d6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.010681] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.010827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.011026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.015674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.015674] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.015674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.015674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.015965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.016160] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.016428] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a6dd9b03-d553-4b7a-b9f5-f9e3b715daba',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.040394] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.178656] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.276871] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 768.277283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.278259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.278644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.278882] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.279076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.279159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.279352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.279468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.279588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.279718] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.290800] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.292532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.292532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.292532] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f11395bc-ee0f-4b83-b013-fde9d4a22269 with status ACTIVE [ 768.292532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.292532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.292532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.293185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.293185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.294206] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.295872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.295978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.296250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.296356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.296599] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.296728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.296795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.297018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.297121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.297225] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f11395bc-ee0f-4b83-b013-fde9d4a22269 is going to be updated. [ 768.333393] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.333746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.333878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.334149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.334370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.334649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f11395bc-ee0f-4b83-b013-fde9d4a22269" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.420345] env[65087]: INFO networking_nsxv3.common.synchronization [req-53f5318b-7ecf-4f84-8ede-dc101cbf6c8d req-a02e8d15-c674-4fc1-8b24-5e39d90def46 tempest-ServersWithSpecificFlavorTestJSON-635744001 tempest-ServersWithSpecificFlavorTestJSON-635744001-project-member] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 768.420763] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 768.421146] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.421285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.421285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.421829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.422077] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.422250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.422327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.422520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.422604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.422890] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.482604] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.482770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.482898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.483075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.483164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.483264] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 768.518564] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.520519] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.520519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.520519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.520842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.520842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.523852] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.523852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.523852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.523852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.523852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.523852] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 is going to be updated. [ 768.523852] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.523852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.523852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.523852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.523852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.524480] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.524480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.524480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.524480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.524480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.524480] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba is going to be updated. [ 768.543659] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.543799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.543945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.544114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.545333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.545494] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.557870] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 768.576087] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.576317] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.576453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.576695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.576855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.581946] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.582126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.582195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.582404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.582544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.597137] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 in Status: IN_PROGRESS for 2s [ 768.598020] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: IN_PROGRESS for 2s [ 768.681936] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.685791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.685791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.685791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.685791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.685791] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 is going to be updated. [ 768.722236] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.722529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.722529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.723334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.723334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.734433] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: IN_PROGRESS for 2s [ 768.758278] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 082fc1a8-0a58-4162-926b-fe01957908a7 in Status: SUCCESS [ 768.758278] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 082fc1a8-0a58-4162-926b-fe01957908a7 deletion is rescheduled due to dependency. [ 768.758278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-082fc1a8-0a58-4162-926b-fe01957908a7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.782599] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.782990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.782990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.784039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.784039] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.784039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.784039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.784039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.784039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.784039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.784452] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.784452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.784452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.784691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.784691] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.784782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.784815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.784999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.785104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.785207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.785306] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.802101] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.828978] env[65087]: INFO networking_nsxv3.common.synchronization [req-a82b9ee3-c790-4ccc-b07c-48fae8ccd3b9 req-b4de1edb-7770-46da-a9c7-bd3af66e722c tempest-ServerTagsTestJSON-223555689 tempest-ServerTagsTestJSON-223555689-project-member] Enqueued Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGHEST for action security_group_members [ 768.829535] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGHEST for action security_group_members [ 768.829885] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.830138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.830256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.833337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.833337] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.833337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.833337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.833337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.833337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.833337] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.925043] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.925383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.925460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.925847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.950508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.951277] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.951277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.951277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.951435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.951435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.952649] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 is going to be updated. [ 768.991397] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.991397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.991397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.991397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.991397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.005268] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: IN_PROGRESS for 2s [ 769.024040] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.052669] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.052832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.052912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.053150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.053274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.053376] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c is going to be updated. [ 769.089300] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.089300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.089300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.089300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.089556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.099479] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: IN_PROGRESS for 2s [ 769.238808] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 769.239218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.288082] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e56f2582-99a0-4048-840f-b0950b64562f: rpc.has_security_group_logging(os_id): False [ 769.297962] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.298231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-310" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.298375] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-310" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.298753] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-310" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.299277] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.299519] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.299705] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.300849] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.301071] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.301564] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.302020] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.302020] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.302020] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.302519] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.302796] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.303040] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.305106] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.305327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.305433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.305671] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.306039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.306039] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be created. [ 769.328705] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.328860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.328922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.331332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.331530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.331754] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.331889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.331963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.333648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.333648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.333648] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.333648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.333648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.333648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.333648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.333648] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.333648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.333648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.334126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.334159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.334392] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 769.336052] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.336191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.336191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.336330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.336412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.337432] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.337432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.337432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.337432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.337753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.337753] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf already deleted. [ 769.337753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.345577] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.345577] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 769.345577] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.345577] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-310" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.345577] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-8c807b80-4e13-4268-8cbc-241974da05da taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.345577] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-8c807b80-4e13-4268-8cbc-241974da05da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.345577] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-8c807b80-4e13-4268-8cbc-241974da05da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.346169] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-8c807b80-4e13-4268-8cbc-241974da05da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.346375] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c807b80-4e13-4268-8cbc-241974da05da',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.362514] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.362738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.362809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.364249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.364249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.391037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: UNINITIALIZED for 2s [ 769.462090] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.463979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.464091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.465216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.465216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.489610] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 769.530288] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.531416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.531416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.531416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.531416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.531842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 769.591564] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.591804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.591904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.592192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.592347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.602358] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 769.849499] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.849725] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.849850] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.850157] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.850305] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.850456] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 8c807b80-4e13-4268-8cbc-241974da05da not found, creating... [ 769.850715] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.850876] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.850987] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.851214] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.851345] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.851664] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.851821] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.852009] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.852234] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.852363] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.852498] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 8c807b80-4e13-4268-8cbc-241974da05da is going to be created. [ 769.874719] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.874962] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.875145] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.875418] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.875657] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.875890] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-8c807b80-4e13-4268-8cbc-241974da05da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.572482] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 770.572753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.572911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.573174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.573387] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.573550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.573619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.573791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.573876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.573965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.574089] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.610187] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba in Status: SUCCESS [ 770.610614] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a6dd9b03-d553-4b7a-b9f5-f9e3b715daba deletion is rescheduled due to dependency. [ 770.610704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a6dd9b03-d553-4b7a-b9f5-f9e3b715daba" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.611423] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 in Status: SUCCESS [ 770.611632] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5fd4ec2-d6c3-4894-bd80-751b7e6176d6 deletion is rescheduled due to dependency. [ 770.611926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5fd4ec2-d6c3-4894-bd80-751b7e6176d6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.641362] env[65087]: INFO networking_nsxv3.common.synchronization [req-a82b9ee3-c790-4ccc-b07c-48fae8ccd3b9 req-a39f9e27-65bf-42b4-8804-5b3ba54191c2 service nova] Enqueued Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGHEST for action security_group_rules [ 770.641447] env[65087]: INFO networking_nsxv3.common.synchronization [req-a82b9ee3-c790-4ccc-b07c-48fae8ccd3b9 req-a39f9e27-65bf-42b4-8804-5b3ba54191c2 service nova] Enqueued Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGHEST for action security_group_members [ 770.641743] env[65087]: INFO networking_nsxv3.common.synchronization [req-a82b9ee3-c790-4ccc-b07c-48fae8ccd3b9 req-a39f9e27-65bf-42b4-8804-5b3ba54191c2 service nova] Enqueued Resource ID: 8c807b80-4e13-4268-8cbc-241974da05da with Priority: HIGHEST for action port [ 770.642287] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGHEST for action security_group_rules [ 770.642434] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGHEST for action security_group_members [ 770.642497] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c807b80-4e13-4268-8cbc-241974da05da with Priority: HIGHEST for action port [ 770.642799] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.642927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.642996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.643281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.643396] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.644356] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.644517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.644558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.645625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.645625] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.645625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.645625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.645625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.645625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.645625] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.646123] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c807b80-4e13-4268-8cbc-241974da05da taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.646664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c807b80-4e13-4268-8cbc-241974da05da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.647484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c807b80-4e13-4268-8cbc-241974da05da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.647484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c807b80-4e13-4268-8cbc-241974da05da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.647484] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c807b80-4e13-4268-8cbc-241974da05da',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.744655] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: SUCCESS [ 770.744913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.022319] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: SUCCESS [ 771.022592] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 deletion is rescheduled due to dependency. [ 771.022709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.085640] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.085948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.086060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.086251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.086426] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.086525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.086588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.086948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.086948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.086948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.087159] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.087268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.087343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.087673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.088925] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.088925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.089661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.090123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.090123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.090123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.090279] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.112286] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: SUCCESS [ 771.112558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.149758] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.151387] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.151387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.151387] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c807b80-4e13-4268-8cbc-241974da05da with status ACTIVE [ 771.151387] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.153362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.153362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.153720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.153720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.153977] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.155707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.155707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.155801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.155901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.156191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.156811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.156811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.156811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.156811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.156982] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c807b80-4e13-4268-8cbc-241974da05da is going to be updated. [ 771.182377] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.182616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.182616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.183018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.183018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.183206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c807b80-4e13-4268-8cbc-241974da05da" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.364806] env[65087]: INFO networking_nsxv3.common.synchronization [req-0c76d842-bf61-4e3b-a6dc-85ab050d9ef9 req-a48bbd4e-003e-45ef-92f8-64fdf1736ff5 tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 771.365697] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 771.366077] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.366209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.366280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.366535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.366777] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.367220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.367344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.367611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.367761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.367920] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.386962] env[65087]: INFO networking_nsxv3.common.synchronization [req-0c76d842-bf61-4e3b-a6dc-85ab050d9ef9 req-a48bbd4e-003e-45ef-92f8-64fdf1736ff5 tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 771.387231] env[65087]: INFO networking_nsxv3.common.synchronization [req-0c76d842-bf61-4e3b-a6dc-85ab050d9ef9 req-a48bbd4e-003e-45ef-92f8-64fdf1736ff5 tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 771.387377] env[65087]: INFO networking_nsxv3.common.synchronization [req-0c76d842-bf61-4e3b-a6dc-85ab050d9ef9 req-a48bbd4e-003e-45ef-92f8-64fdf1736ff5 tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: 226d90d4-6acd-461c-91eb-55fea113ddaf with Priority: HIGHEST for action port [ 771.388731] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_rules [ 771.388808] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 771.388913] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 226d90d4-6acd-461c-91eb-55fea113ddaf with Priority: HIGHEST for action port [ 771.395129] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.395129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.395129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.395129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.395129] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.395129] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.395129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.395129] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-226d90d4-6acd-461c-91eb-55fea113ddaf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.395551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.395551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.395551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.396501] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226d90d4-6acd-461c-91eb-55fea113ddaf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.411606] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: SUCCESS [ 771.411606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.411606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.411606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.411606] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.412375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.412375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.415537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.415768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.415894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.415988] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.505369] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 771.505369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.505667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.505791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.505838] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.596194] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f: rpc.has_security_group_logging(os_id): False [ 771.613252] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 771.613568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.620551] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.620704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.620775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.620997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.621119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.621318] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.621412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.621500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.621635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.621706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.622494] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.622494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.622494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.622697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.622697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.623366] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.623366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.623674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.623674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.623739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.624379] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 771.659219] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.697349] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.697580] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.697693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.698041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.698321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.712817] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 771.870875] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.894795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.894943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.899347] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 226d90d4-6acd-461c-91eb-55fea113ddaf with status ACTIVE [ 771.899593] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.899726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.899795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.900047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.900119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.900316] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.900418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.900479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.900636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.900713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.900902] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.901066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.901144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.901291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.901368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.901453] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 226d90d4-6acd-461c-91eb-55fea113ddaf is going to be updated. [ 771.921695] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.921895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.921936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.924884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.925806] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.925992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.926091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.926308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.926500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.926500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.926681] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.926784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.926847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.927017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.927173] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.927268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.927330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.927468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.927546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.927660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.927727] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.940784] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.940784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.940784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.940784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.940784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.940784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-226d90d4-6acd-461c-91eb-55fea113ddaf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.958393] env[65087]: INFO networking_nsxv3.common.synchronization [req-0071ca8e-2fb4-4d4b-b326-496f2bb1a6b8 req-0b6c6377-397c-4bba-bb25-76900a2b368e tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_members [ 771.958393] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_members [ 771.958393] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.958747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.958747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.959055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.959055] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.959211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.959261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.959433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.959981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.959981] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.009201] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.009412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.009525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.009812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.010070] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.010198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.011089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.011089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.011089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.011089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.011089] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.162545] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.162903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.162903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.163153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.163239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.163341] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf is going to be created. [ 772.199438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.199757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.199839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.200134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.200312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.214505] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf in Status: UNINITIALIZED for 2s [ 772.376187] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.433456] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cdd684c-5a6e-4834-b6e5-a34e0caee842: rpc.has_security_group_logging(os_id): False [ 772.462265] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.463286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.463410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.464110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.464421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.464726] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.464849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.464944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.465527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.465910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.466091] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 already deleted. [ 772.466353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.469473] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.469651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.469743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.470082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.470183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.470398] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.470568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.470720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.470872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.470931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.471242] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.471358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.471416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.471693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.471812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.472155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.472301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.472386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.472562] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.472660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.472751] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be created. [ 772.516226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.516496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.516594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.517030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.517104] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.517198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.517547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.517547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.517658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.517693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.518033] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.518170] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.518259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.518548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.518745] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.518850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.518932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.519116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.519200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.519300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.519441] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.540471] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.540813] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.541044] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.541372] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.541718] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.541881] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.542038] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.542285] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.542520] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.543052] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.543246] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.543371] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.543500] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.543713] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.543831] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.543970] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.546399] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.546620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.546709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.546897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.547087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.562999] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: IN_PROGRESS for 2s [ 772.572196] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.572439] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 772.572744] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.572948] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.573347] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-88790571-860e-478d-ad18-afedbf5e7cff taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.573643] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-88790571-860e-478d-ad18-afedbf5e7cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.573800] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-88790571-860e-478d-ad18-afedbf5e7cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.574207] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-88790571-860e-478d-ad18-afedbf5e7cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.574339] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88790571-860e-478d-ad18-afedbf5e7cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.879999] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.881050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.881050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.881050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.881050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.881050] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be updated. [ 772.916806] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.916806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.916806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.917058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.917092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.930454] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: IN_PROGRESS for 2s [ 773.022397] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e56f2582-99a0-4048-840f-b0950b64562f: rpc.has_security_group_logging(os_id): False [ 773.052178] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.052178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.052344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.052623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.052707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.053025] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.053146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.053211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.053490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.053664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.053918] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.054032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.054093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.054331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.054445] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.054668] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.054805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.054889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.055110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.055188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.055308] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 773.076708] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.077369] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.077686] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.078057] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.078309] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.078549] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 88790571-860e-478d-ad18-afedbf5e7cff not found, creating... [ 773.078859] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.080638] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.080831] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.081184] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.081356] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.081784] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.081951] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.082080] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.082326] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.082467] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.082606] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 88790571-860e-478d-ad18-afedbf5e7cff is going to be created. [ 773.107685] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.107892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.108020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.108314] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.108893] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.108893] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-88790571-860e-478d-ad18-afedbf5e7cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.149360] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.149710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.149710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.149819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.149964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.202441] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 773.731105] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 773.731349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.225713] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf in Status: SUCCESS [ 774.226159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.226159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.226363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.226595] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.226715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.226766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.226918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.226997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.227152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.227227] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.297038] env[65087]: INFO networking_nsxv3.common.synchronization [req-0071ca8e-2fb4-4d4b-b326-496f2bb1a6b8 req-c2b33595-7497-4f06-a54b-ccc339693cb1 service nova] Enqueued Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_rules [ 774.297426] env[65087]: INFO networking_nsxv3.common.synchronization [req-0071ca8e-2fb4-4d4b-b326-496f2bb1a6b8 req-c2b33595-7497-4f06-a54b-ccc339693cb1 service nova] Enqueued Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_members [ 774.297426] env[65087]: INFO networking_nsxv3.common.synchronization [req-0071ca8e-2fb4-4d4b-b326-496f2bb1a6b8 req-c2b33595-7497-4f06-a54b-ccc339693cb1 service nova] Enqueued Resource ID: 88790571-860e-478d-ad18-afedbf5e7cff with Priority: HIGHEST for action port [ 774.297938] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_rules [ 774.298094] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_members [ 774.298196] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88790571-860e-478d-ad18-afedbf5e7cff with Priority: HIGHEST for action port [ 774.298485] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.298615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.298685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.298904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.298990] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.300772] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.301058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.301255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.301623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.301755] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.301890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.301992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.302493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.302614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.302935] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.305019] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-88790571-860e-478d-ad18-afedbf5e7cff taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.305269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88790571-860e-478d-ad18-afedbf5e7cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.305390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88790571-860e-478d-ad18-afedbf5e7cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.305631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88790571-860e-478d-ad18-afedbf5e7cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.305899] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88790571-860e-478d-ad18-afedbf5e7cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.579340] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: SUCCESS [ 774.579340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.730461] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.730783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.730783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.731035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.731917] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.732171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.732171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.732379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.732460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.732686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.732767] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.732981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.732981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.733173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.733371] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.734585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.734585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.734585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.734585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.734585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.734585] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.803725] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.803725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.808510] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.809468] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88790571-860e-478d-ad18-afedbf5e7cff with status ACTIVE [ 774.809672] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.809788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.809851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.810059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.810149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.810322] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.810417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.811033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.811033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.811033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.811033] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.811033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.811234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.811234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.811295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.811377] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88790571-860e-478d-ad18-afedbf5e7cff is going to be updated. [ 774.836928] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.837191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.837243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.837469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.837670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.837897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88790571-860e-478d-ad18-afedbf5e7cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.941847] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 774.942093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.942285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.942517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.942710] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.942828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.942894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.943137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.943175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.943247] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.224931] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 775.224931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.237516] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfdf2f79-21d5-4965-8e78-ad3b2c69cebf: rpc.has_security_group_logging(os_id): False [ 775.264683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.264925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.265056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.265439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.265535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.265870] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.266023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.266425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.266767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.266910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.267252] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.267480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.267611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.267821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.267935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.268375] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.268491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.268541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.268750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.269179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.269588] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf is going to be created. [ 775.314895] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.376972] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.377166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.377271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.377650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.377941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.399979] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf in Status: IN_PROGRESS for 2s [ 775.448575] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.822295] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.822295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.822295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.822712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.822859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.823029] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 is going to be created. [ 775.858388] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.859816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.859816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.859816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.859816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.870958] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 in Status: UNINITIALIZED for 2s [ 775.952584] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.455571] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.455918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.455918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.456051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.456131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.456229] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be updated. [ 776.491022] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.491195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.491252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.491557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.491736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.505924] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: IN_PROGRESS for 2s [ 777.415026] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf in Status: SUCCESS [ 777.415304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.889895] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 in Status: SUCCESS [ 777.890364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.890364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.890688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.890766] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.890849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.890899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.891090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.891211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.891292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.891397] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.394124] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.517763] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 778.518210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.518313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.518514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.518700] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.518836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.518951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.519154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.519240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.519330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.519430] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.898133] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82006ff4-e51b-42b0-a24d-bbd2eef044f1: rpc.has_security_group_logging(os_id): False [ 778.921231] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.921231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.921231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.921231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.921231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.921231] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.921231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.921554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.921554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.921554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.921554] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 is going to be created. [ 778.997501] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.997644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.997735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.997912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.998120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.017235] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 in Status: IN_PROGRESS for 2s [ 779.021931] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.300156] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 779.300156] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 779.524744] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68: rpc.has_security_group_logging(os_id): False [ 779.551761] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.551761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.551761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.551761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.551761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.551761] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.551761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.552763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.554177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.554177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.554177] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be updated. [ 779.577345] env[65087]: INFO networking_nsxv3.common.synchronization [req-c405ae29-05f3-47b0-8100-382d15eb19db req-07b555ea-fabb-4fe9-aecf-6d53f57e8d2e tempest-AttachInterfacesUnderV243Test-494057747 tempest-AttachInterfacesUnderV243Test-494057747-project-member] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 779.577917] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGHEST for action security_group_members [ 779.579040] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.579946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.583024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.583024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.583024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.583024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.583024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.583024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.583024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.583024] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.636597] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.638211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.638211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.638211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.638211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.661506] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: IN_PROGRESS for 2s [ 779.761409] env[65087]: INFO networking_nsxv3.common.synchronization [None req-ab11bc46-392f-45ec-b61a-f4c8b5b1c163 None None] Enqueued Resource ID: f8f60e29-1671-492f-8aef-6c289986eb36 with Priority: HIGHEST for action port [ 779.762581] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8f60e29-1671-492f-8aef-6c289986eb36 with Priority: HIGHEST for action port [ 779.763965] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8f60e29-1671-492f-8aef-6c289986eb36 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.763965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8f60e29-1671-492f-8aef-6c289986eb36" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.763965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8f60e29-1671-492f-8aef-6c289986eb36" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.763965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8f60e29-1671-492f-8aef-6c289986eb36" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.763965] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8f60e29-1671-492f-8aef-6c289986eb36',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.088785] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.090240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.090240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.090240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.090240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.090240] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.094305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.094305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.094305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.094305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.094305] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be updated. [ 780.131280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.131541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.131541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.131797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.131972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.152365] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: IN_PROGRESS for 2s [ 780.267316] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8f60e29-1671-492f-8aef-6c289986eb36 [ 780.267557] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.268047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.268047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.268047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.268193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.268193] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8f60e29-1671-492f-8aef-6c289986eb36 already deleted. [ 780.268253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8f60e29-1671-492f-8aef-6c289986eb36" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.474813] env[65087]: INFO networking_nsxv3.common.synchronization [req-7f4c7fef-d03d-4289-b307-d31d5eff59cf req-8ff415d1-9ae8-43c5-b1e5-407fb77e228d tempest-MultipleCreateTestJSON-1770125270 tempest-MultipleCreateTestJSON-1770125270-project-member] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 780.474813] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 780.474813] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.474813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.474813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.474813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.475436] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.475436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.475436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.475538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.475661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.475699] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.680013] env[65087]: INFO networking_nsxv3.common.synchronization [req-2c74fe48-56e8-4e83-8f39-09bce5748191 req-16949bb7-7587-48d0-bc99-d68c7165163a tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 780.680622] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 780.680980] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.681153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.681226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.681425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.681646] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.681758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.681797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.681957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.682061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.682158] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.919898] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-159 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.919898] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.920104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.920303] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.920593] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.920764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.920888] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.921537] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.921537] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.921537] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.921879] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.921879] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.921879] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.922119] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.922119] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.922477] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.945606] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.945697] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.945801] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.945979] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.946338] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-b4070429-75c8-40e8-a332-1a3d27b8ae7f taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.946533] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-b4070429-75c8-40e8-a332-1a3d27b8ae7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.946681] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-b4070429-75c8-40e8-a332-1a3d27b8ae7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.947104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-b4070429-75c8-40e8-a332-1a3d27b8ae7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.947256] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4070429-75c8-40e8-a332-1a3d27b8ae7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.961731] env[65087]: INFO networking_nsxv3.common.synchronization [req-2c74fe48-56e8-4e83-8f39-09bce5748191 req-173da54e-7bdc-4b9c-aa9a-e40a5bebd70a tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 780.963500] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 780.963741] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.963859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.978802] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.978894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.978927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.979165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.979430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.979594] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.979790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.979887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.980107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.980182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.980311] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 781.025185] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.026242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.026879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.028052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.028441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.039345] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 781.045643] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 in Status: SUCCESS [ 781.045789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.184985] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.324287] env[65087]: INFO networking_nsxv3.common.synchronization [req-2c74fe48-56e8-4e83-8f39-09bce5748191 req-6af5b1c4-a6da-422e-93ce-b90ee6bb6d0a tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 781.326919] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 781.327384] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.327571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.451995] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.452325] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.452809] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.452809] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.452911] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.453025] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port b4070429-75c8-40e8-a332-1a3d27b8ae7f not found, creating... [ 781.453551] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.453551] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.453910] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.453910] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.453910] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.454226] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.454377] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.454484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.454823] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.455067] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.455263] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: b4070429-75c8-40e8-a332-1a3d27b8ae7f is going to be created. [ 781.482266] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.482546] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.482681] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.483052] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.483468] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.483806] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-b4070429-75c8-40e8-a332-1a3d27b8ae7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.677781] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 781.678031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.689159] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.163660] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 in Status: SUCCESS [ 782.163660] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 deletion is rescheduled due to dependency. [ 782.163660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.194628] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.200693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.200693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.200693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.200693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.200693] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 782.230502] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.230731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.230857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.231098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.231595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.243226] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 782.320196] env[65087]: INFO networking_nsxv3.common.synchronization [req-7f4c7fef-d03d-4289-b307-d31d5eff59cf req-1b2fa373-372f-41a6-bf66-504764776a1a service nova] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_rules [ 782.320565] env[65087]: INFO networking_nsxv3.common.synchronization [req-7f4c7fef-d03d-4289-b307-d31d5eff59cf req-1b2fa373-372f-41a6-bf66-504764776a1a service nova] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 782.320565] env[65087]: INFO networking_nsxv3.common.synchronization [req-7f4c7fef-d03d-4289-b307-d31d5eff59cf req-1b2fa373-372f-41a6-bf66-504764776a1a service nova] Enqueued Resource ID: b4070429-75c8-40e8-a332-1a3d27b8ae7f with Priority: HIGHEST for action port [ 782.320848] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_rules [ 782.321141] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 782.321141] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4070429-75c8-40e8-a332-1a3d27b8ae7f with Priority: HIGHEST for action port [ 782.321725] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.321816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.321885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.322239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.322331] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.324030] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.324030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.324172] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4070429-75c8-40e8-a332-1a3d27b8ae7f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.324306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4070429-75c8-40e8-a332-1a3d27b8ae7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.324342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4070429-75c8-40e8-a332-1a3d27b8ae7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.324534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4070429-75c8-40e8-a332-1a3d27b8ae7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.324612] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4070429-75c8-40e8-a332-1a3d27b8ae7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.824914] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.825274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.826318] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4070429-75c8-40e8-a332-1a3d27b8ae7f with status ACTIVE [ 782.827447] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.827447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.827447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.827447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.827447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.827447] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.827447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.827447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.827754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.827754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.827834] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.827935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.827998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.828155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.828289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.828324] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4070429-75c8-40e8-a332-1a3d27b8ae7f is going to be updated. [ 782.853826] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.853826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.853826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.854058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.854226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.854424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4070429-75c8-40e8-a332-1a3d27b8ae7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.051727] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 783.053149] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a deletion is rescheduled due to dependency. [ 783.053149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.053149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.053149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.053149] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.053149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.053457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.053457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.053457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.053542] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.063364] env[65087]: INFO networking_nsxv3.common.synchronization [None req-075536fe-d637-447c-bfeb-a44e99135b7a None None] Enqueued Resource ID: d0f539ed-e51c-4e0b-8878-3e23022d0495 with Priority: HIGHEST for action port [ 783.063364] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0f539ed-e51c-4e0b-8878-3e23022d0495 with Priority: HIGHEST for action port [ 783.063744] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0f539ed-e51c-4e0b-8878-3e23022d0495 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.063877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0f539ed-e51c-4e0b-8878-3e23022d0495" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.064130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0f539ed-e51c-4e0b-8878-3e23022d0495" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.064428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0f539ed-e51c-4e0b-8878-3e23022d0495" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.064495] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0f539ed-e51c-4e0b-8878-3e23022d0495',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.271371] env[65087]: INFO networking_nsxv3.common.synchronization [req-7f4c7fef-d03d-4289-b307-d31d5eff59cf req-7c3c3697-7d20-4735-aeae-316c669c01fc tempest-MultipleCreateTestJSON-1770125270 tempest-MultipleCreateTestJSON-1770125270-project-member] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 783.271916] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 783.272714] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.272714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.559938] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.566678] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0f539ed-e51c-4e0b-8878-3e23022d0495 [ 783.566951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.567149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.567209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.567417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.567523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.567664] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0f539ed-e51c-4e0b-8878-3e23022d0495 already deleted. [ 783.567721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0f539ed-e51c-4e0b-8878-3e23022d0495" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.708082] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-159 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.708277] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.708393] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.708654] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.709572] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.709572] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.709912] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.709912] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.709984] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.710188] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.710300] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.710386] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.710489] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.710592] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.710692] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.710820] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.731301] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.731474] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.731609] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.731977] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-159" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.732148] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-21a44faa-4505-4135-9709-255875516a83 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.732289] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-21a44faa-4505-4135-9709-255875516a83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.732371] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-21a44faa-4505-4135-9709-255875516a83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.732719] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-21a44faa-4505-4135-9709-255875516a83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.732843] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21a44faa-4505-4135-9709-255875516a83',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.063922] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.235272] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.235411] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.235518] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.236851] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.236851] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.236851] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 21a44faa-4505-4135-9709-255875516a83 not found, creating... [ 784.236851] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.236851] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.236851] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.237157] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.237157] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.237899] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.237899] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.237899] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.237899] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.237899] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.238590] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 21a44faa-4505-4135-9709-255875516a83 is going to be created. [ 784.253821] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 784.253947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.254178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.254279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.254461] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.254586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.254689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.254810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.255651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.255651] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.267093] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.267294] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.267426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.267672] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.268656] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.268656] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-21a44faa-4505-4135-9709-255875516a83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.566462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.566776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.566776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.566844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.566877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.567598] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 784.595537] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.595709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.595761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.595998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.596402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.604696] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 784.757950] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.758137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.758241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.758515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.758674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.758924] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.759065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.759158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.759515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.759515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.759608] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 784.787757] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.787932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.787986] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.788282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.788493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.797909] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 785.016128] env[65087]: INFO networking_nsxv3.common.synchronization [req-7f4c7fef-d03d-4289-b307-d31d5eff59cf req-804528ce-d848-4d1d-9c6b-65365e9733f7 service nova] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_rules [ 785.016341] env[65087]: INFO networking_nsxv3.common.synchronization [req-7f4c7fef-d03d-4289-b307-d31d5eff59cf req-804528ce-d848-4d1d-9c6b-65365e9733f7 service nova] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 785.016495] env[65087]: INFO networking_nsxv3.common.synchronization [req-7f4c7fef-d03d-4289-b307-d31d5eff59cf req-804528ce-d848-4d1d-9c6b-65365e9733f7 service nova] Enqueued Resource ID: 21a44faa-4505-4135-9709-255875516a83 with Priority: HIGHEST for action port [ 785.017088] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_rules [ 785.017443] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 785.018657] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21a44faa-4505-4135-9709-255875516a83 with Priority: HIGHEST for action port [ 785.018657] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.018657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.018830] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.018969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.020183] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-21a44faa-4505-4135-9709-255875516a83 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.020183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21a44faa-4505-4135-9709-255875516a83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.020183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21a44faa-4505-4135-9709-255875516a83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.020183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21a44faa-4505-4135-9709-255875516a83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.020183] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21a44faa-4505-4135-9709-255875516a83',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.524598] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21a44faa-4505-4135-9709-255875516a83 with status ACTIVE [ 785.524598] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.524598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.524598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.524598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.524598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.524598] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.524598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.524598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.524598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.525109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.525109] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.525109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.525109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.525269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.525269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.525337] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21a44faa-4505-4135-9709-255875516a83 is going to be updated. [ 785.550128] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.550351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.550421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.551256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.551256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.551441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21a44faa-4505-4135-9709-255875516a83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.398942] env[65087]: INFO networking_nsxv3.common.synchronization [req-5b06119c-e144-457d-a352-277ce1b140cc req-c9d21d49-c0dc-4f62-b443-df30a72014d8 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_members [ 786.399684] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_members [ 786.399983] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.400124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.400197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.400454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.400888] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.400888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.400888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.400888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.401159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.401159] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.619126] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 786.619126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.619126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.619126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.619126] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.619126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.619126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.619126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.619126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.620045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.620448] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.623036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.623036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.623036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.623036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.623036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.625019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.625019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.625019] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.809146] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 786.809531] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f deletion is rescheduled due to dependency. [ 786.809733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.809981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.810381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.810644] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.810889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.812172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.812351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.812451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.812569] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.870805] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.870805] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.870805] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.870805] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.871421] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.871687] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.871823] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.872187] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.872348] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.872677] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.872823] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.872931] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.873306] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.873698] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.873904] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.874168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.900563] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.900742] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.900901] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.901077] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.901414] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.901613] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.901944] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.902108] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.902248] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.904966] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.906029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.906029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.906029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.906029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.906332] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.906440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.906893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.906893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.906893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.906893] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 already deleted. [ 786.907151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.172295] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.172451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.172589] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.314812] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.315254] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.315254] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.315439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.315489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.315689] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.315796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.315854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.316069] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.316188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.316188] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 787.343875] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.344094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.344138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.344362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.344514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.356163] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 787.408734] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.409249] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.409249] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.409366] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.409505] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.409654] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd not found, creating... [ 787.409948] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.410120] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.410548] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.410548] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.410548] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.410911] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.411150] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.411331] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.411517] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.411670] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.411813] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd is going to be created. [ 787.430996] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.431312] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.431581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.431828] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.432087] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.432355] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.676494] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.181653] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.181837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.181962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.182199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.182323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.182452] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 788.217378] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.217523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.217679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.217779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.217947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.231248] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 788.266725] env[65087]: INFO networking_nsxv3.common.synchronization [req-5b06119c-e144-457d-a352-277ce1b140cc req-82fe856c-ab7d-4c7d-b2c5-05dd8a911170 service nova] Enqueued Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_rules [ 788.266980] env[65087]: INFO networking_nsxv3.common.synchronization [req-5b06119c-e144-457d-a352-277ce1b140cc req-82fe856c-ab7d-4c7d-b2c5-05dd8a911170 service nova] Enqueued Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_members [ 788.267055] env[65087]: INFO networking_nsxv3.common.synchronization [req-5b06119c-e144-457d-a352-277ce1b140cc req-82fe856c-ab7d-4c7d-b2c5-05dd8a911170 service nova] Enqueued Resource ID: 1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd with Priority: HIGHEST for action port [ 788.267780] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_rules [ 788.267780] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_members [ 788.267877] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd with Priority: HIGHEST for action port [ 788.268173] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.268391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.268391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.268597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.268651] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.269669] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.269768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.269867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.269977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.270178] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.270294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.270410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.270507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.270592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.270709] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.271975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.271975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.271975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.271975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.272314] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.774088] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.774633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.774633] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.779764] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd with status ACTIVE [ 788.780331] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.780747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.780840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.781050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.781288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.781419] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.781419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.781613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.781757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.781757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.781945] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.782037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.782037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.782234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.782234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.782422] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd is going to be updated. [ 788.809183] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.809402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.809402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.809592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.809728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.809885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f9111b6-a1cc-43e5-a0e7-5bc766b38cbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.883940] env[65087]: INFO networking_nsxv3.common.synchronization [req-79bc6c74-3e4b-4539-847a-1bb5985fd19a req-3ebde5e9-4927-43be-9f54-981651fa9629 tempest-ListImageFiltersTestJSON-1884000138 tempest-ListImageFiltersTestJSON-1884000138-project-member] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 788.884599] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 788.885072] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.885271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.885390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.885659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.885828] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.885934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.886026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.886182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.886270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.886387] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.278263] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.368513] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 789.369700] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f deletion is rescheduled due to dependency. [ 789.369700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.373025] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.373025] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.374801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.374801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.374801] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.374801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.374801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.374801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.374801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.375838] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.376217] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.376382] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.377082] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.377082] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.377082] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.377082] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.388723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.388723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.388820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.389351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.389351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.389464] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.389542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.389607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.389758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.389836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.389920] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb already deleted. [ 789.390022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.397531] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.397531] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.397531] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.397706] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.398035] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-049a68d0-1cbc-4081-be59-6c44629c9cad taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.398207] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-049a68d0-1cbc-4081-be59-6c44629c9cad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.398313] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-049a68d0-1cbc-4081-be59-6c44629c9cad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.398626] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-049a68d0-1cbc-4081-be59-6c44629c9cad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.398758] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('049a68d0-1cbc-4081-be59-6c44629c9cad',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.780359] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.780694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.780694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.780871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.780979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.781102] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 is going to be created. [ 789.807442] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.807589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.807683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.807859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.808030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.818659] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 in Status: UNINITIALIZED for 2s [ 789.901558] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.901847] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.902699] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.902699] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.902699] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.902699] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 049a68d0-1cbc-4081-be59-6c44629c9cad not found, creating... [ 789.902862] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.903020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.903145] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.903374] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.903554] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.903936] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.906654] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.906654] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.906654] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.906654] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.906654] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 049a68d0-1cbc-4081-be59-6c44629c9cad is going to be created. [ 789.937900] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.938574] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.938574] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.938826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.939129] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.939428] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-049a68d0-1cbc-4081-be59-6c44629c9cad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.245511] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 790.245968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.246412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.246794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.247106] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.247284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.247395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.247805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.247987] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.248212] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.569825] env[65087]: INFO networking_nsxv3.common.synchronization [None req-762fdf49-6a8c-42b8-b16b-8ec6fc88312f None None] Enqueued Resource ID: 8c595e25-18bd-4484-8df8-dd4e7545176e with Priority: HIGHEST for action port [ 790.570354] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c595e25-18bd-4484-8df8-dd4e7545176e with Priority: HIGHEST for action port [ 790.570746] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c595e25-18bd-4484-8df8-dd4e7545176e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.570946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c595e25-18bd-4484-8df8-dd4e7545176e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.571028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c595e25-18bd-4484-8df8-dd4e7545176e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.571327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c595e25-18bd-4484-8df8-dd4e7545176e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.571422] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c595e25-18bd-4484-8df8-dd4e7545176e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.708711] env[65087]: INFO networking_nsxv3.common.synchronization [req-79bc6c74-3e4b-4539-847a-1bb5985fd19a req-cf0b4616-233d-4e50-b2a1-c9fbb7a34e2a service nova] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_rules [ 790.708993] env[65087]: INFO networking_nsxv3.common.synchronization [req-79bc6c74-3e4b-4539-847a-1bb5985fd19a req-cf0b4616-233d-4e50-b2a1-c9fbb7a34e2a service nova] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 790.708993] env[65087]: INFO networking_nsxv3.common.synchronization [req-79bc6c74-3e4b-4539-847a-1bb5985fd19a req-cf0b4616-233d-4e50-b2a1-c9fbb7a34e2a service nova] Enqueued Resource ID: 049a68d0-1cbc-4081-be59-6c44629c9cad with Priority: HIGHEST for action port [ 790.709560] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_rules [ 790.710952] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 790.710952] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 049a68d0-1cbc-4081-be59-6c44629c9cad with Priority: HIGHEST for action port [ 790.710952] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.710952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.710952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.710952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.710952] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.712077] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.712207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.712271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.712997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.712997] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.712997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.712997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.712997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.713486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.713486] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.715192] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-049a68d0-1cbc-4081-be59-6c44629c9cad taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.715326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-049a68d0-1cbc-4081-be59-6c44629c9cad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.715393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-049a68d0-1cbc-4081-be59-6c44629c9cad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.715648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-049a68d0-1cbc-4081-be59-6c44629c9cad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.715648] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('049a68d0-1cbc-4081-be59-6c44629c9cad',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.753112] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.079463] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c595e25-18bd-4484-8df8-dd4e7545176e [ 791.080194] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.080194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.080194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.080479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.080479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.080479] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c595e25-18bd-4484-8df8-dd4e7545176e already deleted. [ 791.080599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c595e25-18bd-4484-8df8-dd4e7545176e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.085363] env[65087]: INFO networking_nsxv3.common.synchronization [req-353d49cb-acd4-4402-9285-4ba30dcd1477 req-0412f253-9b72-4d5a-9537-ed3fe700fc6a tempest-FloatingIPsAssociationTestJSON-1186937205 tempest-FloatingIPsAssociationTestJSON-1186937205-project-member] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 791.085505] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGHEST for action security_group_members [ 791.085932] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.085932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.085932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.092313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.092529] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.092653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.092712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.092897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.092986] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.093105] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.218079] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.218292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.218352] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.224452] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 049a68d0-1cbc-4081-be59-6c44629c9cad with status ACTIVE [ 791.224452] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.224630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.224744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.224965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.225074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.225280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.225389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.225510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.225679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.225781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.225968] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.226137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.226205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.226362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.226439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.226530] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 049a68d0-1cbc-4081-be59-6c44629c9cad is going to be updated. [ 791.257938] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.261447] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.261447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.261447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.261764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.261909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.262093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-049a68d0-1cbc-4081-be59-6c44629c9cad" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.595128] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.598875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.599029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.599256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.599355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.599581] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.599700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.599765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.599930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.600019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.600109] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 is going to be updated. [ 791.631977] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.631977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.631977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.631977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.632256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.645585] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: IN_PROGRESS for 2s [ 791.667868] env[65087]: INFO networking_nsxv3.common.synchronization [req-b140391f-803e-48fb-8e25-20b30ed141fc req-4bc80615-d168-4dbf-9deb-f858aba54e64 tempest-ServersWithSpecificFlavorTestJSON-635744001 tempest-ServersWithSpecificFlavorTestJSON-635744001-project-member] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 791.668206] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 791.668811] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.668811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.668811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.668980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.669214] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.669321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.669385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.669539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.669625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.670342] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.704846] env[65087]: INFO networking_nsxv3.common.synchronization [req-3ceab518-9caf-46e4-98fc-c595e28f7564 req-bad57bdb-9fb4-4187-af09-29edc8af6ecb tempest-ServersAdminNegativeTestJSON-2073613632 tempest-ServersAdminNegativeTestJSON-2073613632-project-member] Enqueued Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 791.705527] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c with Priority: HIGHEST for action security_group_members [ 791.705852] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fb66ad5-69f7-466f-94b1-24f53af1b70c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.707088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.707283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.707538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.707710] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.707827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.707897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.708036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.708134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.708219] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fb66ad5-69f7-466f-94b1-24f53af1b70c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.721482] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.760408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.760408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.760408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.760408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.760803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.760803] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 791.797558] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.797700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.797775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.798392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.798392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.807997] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 791.829926] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 in Status: SUCCESS [ 791.832115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.832115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.832115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.832115] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.832115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.832115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.832115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.832115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.832115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.832115] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.982888] env[65087]: INFO networking_nsxv3.common.synchronization [req-9dcd091d-5d27-4ae5-9fcf-3c0c37c9a6ac req-54d49bd5-ce11-4b70-b20e-308ff4b3f067 tempest-ServerTagsTestJSON-223555689 tempest-ServerTagsTestJSON-223555689-project-member] Enqueued Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGHEST for action security_group_members [ 791.983045] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGHEST for action security_group_members [ 791.983368] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.983497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.983572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.983816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.983979] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.984940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.984940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.984940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.984940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.984940] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.142835] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-788 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.143294] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-788" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.143961] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-788" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.144260] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-788" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.145078] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.145078] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.145078] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.145297] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.145297] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.145994] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.145994] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.145994] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.145994] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.145994] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.146233] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.146350] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.170569] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.170806] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 792.170900] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.171088] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-788" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.171428] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-4be53cdb-cf40-42b0-9966-9617fbc98897 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.172256] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-4be53cdb-cf40-42b0-9966-9617fbc98897" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.172634] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-4be53cdb-cf40-42b0-9966-9617fbc98897" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.173138] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-4be53cdb-cf40-42b0-9966-9617fbc98897" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.173308] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4be53cdb-cf40-42b0-9966-9617fbc98897',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.178412] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.178412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.178412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.178412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.178412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.178412] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.178412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.178412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.178412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.178412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.178412] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 is going to be updated. [ 792.210032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.210032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.210032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.210032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.210032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.219954] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.219954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.219954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.219954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.221829] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: IN_PROGRESS for 2s [ 792.227071] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.227322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.227322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.228347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.228347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.228347] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb is going to be created. [ 792.245952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.246963] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.246963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.246963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.246963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.247443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.247986] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c is going to be updated. [ 792.270031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.270031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.270031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.270031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.270031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.295845] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: UNINITIALIZED for 2s [ 792.300645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.300813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.300855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.301134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.301297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.316197] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: IN_PROGRESS for 2s [ 792.335686] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.488449] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.488655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.488754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.488954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.489073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.489276] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.489389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.489559] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.489620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.489682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.489769] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf is going to be updated. [ 792.518466] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.518679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.518679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.518973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.519156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.529140] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf in Status: IN_PROGRESS for 2s [ 792.677258] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.677529] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.677651] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.677875] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.678062] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.678237] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 4be53cdb-cf40-42b0-9966-9617fbc98897 not found, creating... [ 792.678509] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.678681] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.678791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.679047] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.679905] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.680258] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.680421] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.680534] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.680754] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.680894] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.681041] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 4be53cdb-cf40-42b0-9966-9617fbc98897 is going to be created. [ 792.704503] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.704503] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.704503] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.704503] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.704785] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.705063] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-4be53cdb-cf40-42b0-9966-9617fbc98897" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.840363] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3: rpc.has_security_group_logging(os_id): False [ 792.864311] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.864860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.865134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.867021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.867021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.867021] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.867021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.867021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.867021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.867021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.867021] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 is going to be created. [ 792.958464] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.958900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.958900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.958900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.959087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.971187] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 in Status: IN_PROGRESS for 2s [ 793.138937] env[65087]: INFO networking_nsxv3.common.synchronization [None req-cf5edd23-9fa4-4554-bd24-18176bc48a67 tempest-ServerActionsV293TestJSON-527788909 tempest-ServerActionsV293TestJSON-527788909-project-member] Enqueued Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_rules [ 793.139585] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_rules [ 793.139902] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13c5346a-4114-4ee9-bda4-7f968a612f58 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.140163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.140266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.141627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.141627] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.322807] env[65087]: INFO networking_nsxv3.common.synchronization [None req-a33d7fd3-4896-4336-a478-0da108ffcabd None None] Enqueued Resource ID: 51a632ba-ca61-40b8-bc87-389f6a70c357 with Priority: HIGHEST for action port [ 793.324133] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51a632ba-ca61-40b8-bc87-389f6a70c357 with Priority: HIGHEST for action port [ 793.324567] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-51a632ba-ca61-40b8-bc87-389f6a70c357 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.324817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51a632ba-ca61-40b8-bc87-389f6a70c357" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.324817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51a632ba-ca61-40b8-bc87-389f6a70c357" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.326907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51a632ba-ca61-40b8-bc87-389f6a70c357" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.326907] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51a632ba-ca61-40b8-bc87-389f6a70c357',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.390502] env[65087]: INFO networking_nsxv3.common.synchronization [None req-191a3c6c-fd9c-4e42-ab61-efd4320b6074 tempest-ServerActionsV293TestJSON-527788909 tempest-ServerActionsV293TestJSON-527788909-project-member] Enqueued Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_rules [ 793.391359] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_rules [ 793.391917] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13c5346a-4114-4ee9-bda4-7f968a612f58 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.391917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.505233] env[65087]: INFO networking_nsxv3.common.synchronization [req-b140391f-803e-48fb-8e25-20b30ed141fc req-80f1ebcd-0a3b-4254-aaad-fc373066723a service nova] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_rules [ 793.505233] env[65087]: INFO networking_nsxv3.common.synchronization [req-b140391f-803e-48fb-8e25-20b30ed141fc req-80f1ebcd-0a3b-4254-aaad-fc373066723a service nova] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 793.505233] env[65087]: INFO networking_nsxv3.common.synchronization [req-b140391f-803e-48fb-8e25-20b30ed141fc req-80f1ebcd-0a3b-4254-aaad-fc373066723a service nova] Enqueued Resource ID: 4be53cdb-cf40-42b0-9966-9617fbc98897 with Priority: HIGHEST for action port [ 793.505233] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_rules [ 793.505233] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 793.505403] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be53cdb-cf40-42b0-9966-9617fbc98897 with Priority: HIGHEST for action port [ 793.505669] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.505833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.505920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.506825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.507094] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.510056] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.510223] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.510512] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-4be53cdb-cf40-42b0-9966-9617fbc98897 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.510608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4be53cdb-cf40-42b0-9966-9617fbc98897" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.510658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4be53cdb-cf40-42b0-9966-9617fbc98897" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.510842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4be53cdb-cf40-42b0-9966-9617fbc98897" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.510939] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4be53cdb-cf40-42b0-9966-9617fbc98897',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.655285] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 in Status: SUCCESS [ 793.655986] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 deletion is rescheduled due to dependency. [ 793.655986] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.662112] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.662255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.662328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.662538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.662833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.662833] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 already deleted. [ 793.662833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.662958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.663450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.663450] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.818234] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 793.818465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.818629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.818845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.819057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.819179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.819274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.819551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.819551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.819653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.819796] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.819885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.819948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.820103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.820239] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.820326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.820380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.820502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.820573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.820655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.820744] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.830117] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51a632ba-ca61-40b8-bc87-389f6a70c357 [ 793.830323] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.830442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.830508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.830949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.831033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.831072] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51a632ba-ca61-40b8-bc87-389f6a70c357 already deleted. [ 793.831159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51a632ba-ca61-40b8-bc87-389f6a70c357" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.012973] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.012973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.015224] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4be53cdb-cf40-42b0-9966-9617fbc98897 with status ACTIVE [ 794.015945] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.016252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.016544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.016842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.017022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.017309] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.017464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.017601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.017777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.017907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.018164] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.018265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.018982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.018982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.018982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.018982] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4be53cdb-cf40-42b0-9966-9617fbc98897 is going to be updated. [ 794.048028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.048316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.048426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.048746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.051024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.051024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4be53cdb-cf40-42b0-9966-9617fbc98897" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.201221] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.201221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.201221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.201600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.201600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.201600] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 already deleted. [ 794.201600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.235874] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: SUCCESS [ 794.236018] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 deletion is rescheduled due to dependency. [ 794.236118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.236438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.236499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.236697] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.236816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.236882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.237082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.237166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.237260] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.307203] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: SUCCESS [ 794.307564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.307761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.308506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.308506] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.308506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.308506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.308832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.308832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.308832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.308973] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.327053] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c in Status: SUCCESS [ 794.327053] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fb66ad5-69f7-466f-94b1-24f53af1b70c deletion is rescheduled due to dependency. [ 794.327053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fb66ad5-69f7-466f-94b1-24f53af1b70c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.327053] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e38df862-3877-4fbb-b2b8-8702550f272a: rpc.has_security_group_logging(os_id): False [ 794.332369] env[65087]: INFO networking_nsxv3.common.synchronization [req-8b08ba22-80b6-40f4-8b6b-f2b87b7ce36e req-2471d6a8-3657-47b3-8a40-4e31ad94a31c tempest-ListImageFiltersTestJSON-1884000138 tempest-ListImageFiltersTestJSON-1884000138-project-member] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 794.333551] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 794.334666] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.334971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.334971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.335628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.335823] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.335973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.336081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.336221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.336307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.336408] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.353441] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.353441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.353441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.353441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.353441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.353441] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.353441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.353441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.353752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.353752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.353752] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.353882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.353911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.354943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.355114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.355350] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.355498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.355588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.355763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.355875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.355989] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 794.446753] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.446753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.446753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.446753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.446753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.475329] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 794.543493] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf in Status: SUCCESS [ 794.543876] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf deletion is rescheduled due to dependency. [ 794.543876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.739566] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.744213] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.744509] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.744677] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.745031] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.745358] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.745595] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.745831] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.746205] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.746455] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.746713] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.746901] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.747805] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.747805] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.747805] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.747805] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.747805] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.772473] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.772749] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.772869] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.773124] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.773534] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-15bdfeed-d822-4073-a7f2-fffb6a7fc967 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.773631] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-15bdfeed-d822-4073-a7f2-fffb6a7fc967" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.773897] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-15bdfeed-d822-4073-a7f2-fffb6a7fc967" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.774278] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-15bdfeed-d822-4073-a7f2-fffb6a7fc967" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.774467] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15bdfeed-d822-4073-a7f2-fffb6a7fc967',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.813756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.813983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.842684] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.985666] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 in Status: SUCCESS [ 794.985902] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.242389] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.277244] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.277953] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.278092] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.278387] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.278534] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.278687] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 15bdfeed-d822-4073-a7f2-fffb6a7fc967 not found, creating... [ 795.278947] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.279109] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.279213] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.279483] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.279555] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.279823] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.280038] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.280162] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.280262] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.280600] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.280600] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 15bdfeed-d822-4073-a7f2-fffb6a7fc967 is going to be created. [ 795.307672] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.307978] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.308295] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.308513] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.308834] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.309146] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-15bdfeed-d822-4073-a7f2-fffb6a7fc967" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.345481] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.745090] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.745312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.745415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.745895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.745895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.746174] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 is going to be updated. [ 795.781070] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.781338] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.781421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.781653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.781821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.793505] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: IN_PROGRESS for 2s [ 795.848209] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.848412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.848474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.849173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.849173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.849173] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb is going to be updated. [ 795.887448] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.887660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.887705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.887953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.888364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.902367] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: IN_PROGRESS for 2s [ 796.058159] env[65087]: INFO networking_nsxv3.common.synchronization [req-8b08ba22-80b6-40f4-8b6b-f2b87b7ce36e req-aeb9fab2-01f5-4a88-a827-b86c92ca702b service nova] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_rules [ 796.058312] env[65087]: INFO networking_nsxv3.common.synchronization [req-8b08ba22-80b6-40f4-8b6b-f2b87b7ce36e req-aeb9fab2-01f5-4a88-a827-b86c92ca702b service nova] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 796.058481] env[65087]: INFO networking_nsxv3.common.synchronization [req-8b08ba22-80b6-40f4-8b6b-f2b87b7ce36e req-aeb9fab2-01f5-4a88-a827-b86c92ca702b service nova] Enqueued Resource ID: 15bdfeed-d822-4073-a7f2-fffb6a7fc967 with Priority: HIGHEST for action port [ 796.059140] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_rules [ 796.059303] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 796.059481] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15bdfeed-d822-4073-a7f2-fffb6a7fc967 with Priority: HIGHEST for action port [ 796.059663] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.059862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.060334] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.060334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.061089] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-15bdfeed-d822-4073-a7f2-fffb6a7fc967 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.061089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15bdfeed-d822-4073-a7f2-fffb6a7fc967" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.061089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15bdfeed-d822-4073-a7f2-fffb6a7fc967" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.061089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15bdfeed-d822-4073-a7f2-fffb6a7fc967" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.061089] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15bdfeed-d822-4073-a7f2-fffb6a7fc967',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.493579] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 796.493865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.494094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.494312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.494417] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.563642] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15bdfeed-d822-4073-a7f2-fffb6a7fc967 with status ACTIVE [ 796.563929] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.564143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.564214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.564402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.564491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.564687] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.564819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.564887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.565071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.565156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.565347] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.565888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.566096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.567870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.567870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.567870] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15bdfeed-d822-4073-a7f2-fffb6a7fc967 is going to be updated. [ 796.587243] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.587512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.587567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.587843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.588052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.588260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15bdfeed-d822-4073-a7f2-fffb6a7fc967" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.996970] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.997188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.997237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.997514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.997696] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.997800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.997867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.998078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.000061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.000061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.000061] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.502024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.502416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.502416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.502483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.504261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.504261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.504261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.504261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.505209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.505209] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.805660] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: SUCCESS [ 797.805942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.807613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.807613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.807613] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.807613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.807613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.807613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.807880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.807880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.808044] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.913859] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: SUCCESS [ 797.914253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.914418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.914581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.914781] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.914901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.914969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.915153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.915238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.915327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.915515] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.915602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.915728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.915860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.915959] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.916116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.916210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.916297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.916357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.916443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.916550] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.917798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.917798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.917983] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.918048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.918122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.918328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.918385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.918526] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.010199] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e38df862-3877-4fbb-b2b8-8702550f272a: rpc.has_security_group_logging(os_id): False [ 798.036054] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.036054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.036054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.036054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.036054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.036054] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.036054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.036054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.036939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.037243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.040027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.040027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.040027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.040027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.040027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.040027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.040027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.040027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.040027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.040027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.040027] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 798.248754] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.249017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.249140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.252150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.252150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.275572] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 798.311688] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.420185] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4299363c-8eac-44c8-95f4-12c59a4c43bb: rpc.has_security_group_logging(os_id): False [ 798.422155] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.444133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.444323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.444385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.444619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.444797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.445051] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.445181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.445258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.445434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.445516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.445706] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.445876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.445925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.446140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.446226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.446446] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.446587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.446674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.446824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.446896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.446982] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb is going to be created. [ 798.519567] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.519896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.519937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.520171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.520356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.530358] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: IN_PROGRESS for 2s [ 798.814558] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b5dadcb-8f3a-482e-b14c-24a6ef163d88: rpc.has_security_group_logging(os_id): False [ 798.835647] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.836633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.836633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.836633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.836633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.836633] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.837248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.837248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.837248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.837248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.837248] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 is going to be updated. [ 798.853047] env[65087]: INFO networking_nsxv3.common.synchronization [req-e4f0d700-7c36-46f0-b1ed-4c9c6e58abc2 req-cbfd16e8-6974-4446-abb2-204fd280865e tempest-MultipleCreateTestJSON-1770125270 tempest-MultipleCreateTestJSON-1770125270-project-member] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 798.853969] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 798.854701] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.854894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.854957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.855288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.855569] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.855725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.855835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.856089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.856378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.856454] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.917460] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.917663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.917732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.917932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.918109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.924484] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.936473] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: IN_PROGRESS for 2s [ 799.340139] env[65087]: INFO networking_nsxv3.common.synchronization [None req-2f56edac-295b-493a-9d17-f7bc69c008b2 tempest-ServerRescueNegativeTestJSON-853652026 tempest-ServerRescueNegativeTestJSON-853652026-project-member] Enqueued Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_rules [ 799.340139] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_rules [ 799.340139] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.340139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.340139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.340139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.340139] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.359366] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.427960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.427960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.427960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.428234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.428234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.428308] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb is going to be updated. [ 799.460032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.460032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.460032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.460032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.460032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.462732] env[65087]: INFO networking_nsxv3.common.synchronization [None req-ba53de74-a726-4d0a-addf-ef5f817982b5 tempest-ServerRescueNegativeTestJSON-853652026 tempest-ServerRescueNegativeTestJSON-853652026-project-member] Enqueued Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_rules [ 799.464038] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_rules [ 799.464458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.464678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.467673] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: IN_PROGRESS for 2s [ 799.502129] env[65087]: INFO networking_nsxv3.common.synchronization [req-940be75f-0625-4123-899e-e6c034496dee req-a307de2a-e0a9-48fb-ae40-50021c2bb9ec tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 799.502129] env[65087]: INFO networking_nsxv3.common.synchronization [req-940be75f-0625-4123-899e-e6c034496dee req-a307de2a-e0a9-48fb-ae40-50021c2bb9ec tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 799.502286] env[65087]: INFO networking_nsxv3.common.synchronization [req-940be75f-0625-4123-899e-e6c034496dee req-a307de2a-e0a9-48fb-ae40-50021c2bb9ec tempest-SecurityGroupsTestJSON-282876088 tempest-SecurityGroupsTestJSON-282876088-project-member] Enqueued Resource ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 with Priority: HIGHEST for action security_group_members [ 799.502715] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGHEST for action security_group_members [ 799.502857] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 with Priority: HIGHEST for action security_group_members [ 799.502941] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 with Priority: HIGHEST for action security_group_members [ 799.503280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.503406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.503472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.503677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.503898] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.504220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.504314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.504484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.504574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.504669] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.505650] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3c0a5a-197c-4c4c-a82b-9342302fe922 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.506980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.506980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.506980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.506980] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.506980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.506980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.506980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.506980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.506980] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3c0a5a-197c-4c4c-a82b-9342302fe922',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.509693] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-851d68f8-1229-406c-ac33-c91b60c34ee0 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.509837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.509896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.510140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.510308] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.510308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.510459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.510526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.510571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.510661] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('851d68f8-1229-406c-ac33-c91b60c34ee0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.861451] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.863968] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.864149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.864225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.864423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.864546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.864614] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d49db7-880a-475c-959f-8bf596c72350 already deleted. [ 799.864704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.864886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.865615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.865717] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.016150] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.016150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.016150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.016150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.016150] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.016150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.016150] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.016150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.036280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.036280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.036280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.036280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.037519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.037519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.037519] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc is going to be updated. [ 800.038712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.038712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.038857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.039620] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.039620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.039620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.039620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.039620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.039941] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 is going to be updated. [ 800.040710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.040908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.064218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.064482] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.064675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.064722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.064976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.065087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.065179] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 is going to be updated. [ 800.073552] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.073552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.073552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.073789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.073964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.076319] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.076465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.076525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.076963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.077072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.088173] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: IN_PROGRESS for 2s [ 800.090570] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: IN_PROGRESS for 2s [ 800.120496] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.120496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.120496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.120496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.120496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.134528] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 in Status: IN_PROGRESS for 2s [ 800.154040] env[65087]: INFO networking_nsxv3.common.synchronization [req-393115a9-f023-4aa4-9f83-d69cfc4b77cf req-fe89a94b-fa74-4753-b1f6-9c0d3573da3b tempest-MultipleCreateTestJSON-1770125270 tempest-MultipleCreateTestJSON-1770125270-project-member] Enqueued Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 800.154841] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38df862-3877-4fbb-b2b8-8702550f272a with Priority: HIGHEST for action security_group_members [ 800.155493] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e38df862-3877-4fbb-b2b8-8702550f272a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.155493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.318868] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 800.318868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.365765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.365765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.365765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.365966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.365966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.366064] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 800.395181] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.395181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.395181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.395181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.395181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.395377] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d49db7-880a-475c-959f-8bf596c72350 already deleted. [ 800.395377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.437207] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.437402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.437455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.437738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.437855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.450219] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 800.545257] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: SUCCESS [ 800.545775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.545775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.546047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.546157] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.763533] env[65087]: INFO networking_nsxv3.common.synchronization [req-b1acb3ee-11eb-470c-9721-92517c660139 req-02d206cf-7cf6-4161-aa28-c86a9616bef0 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 800.764230] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 800.764534] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.764650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.764733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.764949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.765125] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.765216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.765278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.765494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.765494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.765619] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.953962] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: SUCCESS [ 800.953962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.052328] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.052328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.267583] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.267767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.267810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.268073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.268185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.268402] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.268517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.268640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.268744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.268821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.268910] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be updated. [ 801.313274] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.313413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.313483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.313698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.314435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.329746] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: IN_PROGRESS for 2s [ 801.479604] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: SUCCESS [ 801.479841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.480024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.480241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.481187] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.481187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.481187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.481187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.481187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.481187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.481187] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.983181] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.984165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.984165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.984368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.984438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.984520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.984584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.984713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.984805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.984890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.985849] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.985849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.985849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.985849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.985849] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.985849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.985849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.985849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.985849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.985849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.986279] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.105882] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc in Status: SUCCESS [ 802.106196] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc deletion is rescheduled due to dependency. [ 802.106328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.109051] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 in Status: SUCCESS [ 802.109238] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3c0a5a-197c-4c4c-a82b-9342302fe922 deletion is rescheduled due to dependency. [ 802.109320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3c0a5a-197c-4c4c-a82b-9342302fe922" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.147322] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 in Status: SUCCESS [ 802.147528] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 851d68f8-1229-406c-ac33-c91b60c34ee0 deletion is rescheduled due to dependency. [ 802.147650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-851d68f8-1229-406c-ac33-c91b60c34ee0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.460220] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 802.461095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.461095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.461095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.461816] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.461816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.461816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.461816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.461816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.461816] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e38df862-3877-4fbb-b2b8-8702550f272a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.488795] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4299363c-8eac-44c8-95f4-12c59a4c43bb: rpc.has_security_group_logging(os_id): False [ 802.508675] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.508758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.508845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.510909] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.510909] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.510909] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.510909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.511986] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.511986] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.511986] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.511986] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb is going to be updated. [ 802.575124] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.575344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.575410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.575630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.575787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.590387] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: IN_PROGRESS for 2s [ 802.841413] env[65087]: INFO networking_nsxv3.common.synchronization [req-d97fac86-0733-4d2d-be9c-7d3867efab1e req-69abfcc5-8051-43c9-b91e-c40f96128cc4 tempest-ServersNegativeTestJSON-734531957 tempest-ServersNegativeTestJSON-734531957-project-member] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 802.842104] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 802.842675] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.842675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.842675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.843049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.843049] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.843049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.843049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.843410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.843410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.843495] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.966188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.966188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.966188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.966188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.966188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.966188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.966188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.966188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.966188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.966188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.966188] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a is going to be updated. [ 802.998702] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.999034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.999034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.999210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.000947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.010283] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: IN_PROGRESS for 2s [ 803.156283] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-329 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.156283] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.156283] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.156512] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.156676] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.156896] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.157175] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.157226] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.157373] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.157596] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 803.157714] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.157815] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.157916] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.158040] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 803.158159] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.158282] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.182158] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.182409] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 803.182551] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.182660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.183046] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-6eb2e786-d48c-46b1-a98a-5dd089146a7f taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.183255] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-6eb2e786-d48c-46b1-a98a-5dd089146a7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.183396] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-6eb2e786-d48c-46b1-a98a-5dd089146a7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.183733] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-6eb2e786-d48c-46b1-a98a-5dd089146a7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.183905] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb2e786-d48c-46b1-a98a-5dd089146a7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.340939] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: SUCCESS [ 803.340939] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 deletion is rescheduled due to dependency. [ 803.341100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.347234] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.686996] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.687270] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.687405] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.687721] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.687889] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.688186] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 6eb2e786-d48c-46b1-a98a-5dd089146a7f not found, creating... [ 803.689396] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.689396] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.689396] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.689396] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.689396] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.689700] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.689700] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.690016] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.690266] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.690429] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.690632] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 6eb2e786-d48c-46b1-a98a-5dd089146a7f is going to be created. [ 803.716326] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.716613] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.716681] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.716932] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.717208] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.717452] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-6eb2e786-d48c-46b1-a98a-5dd089146a7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.850331] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.352423] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.353050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.353050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.353050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.353231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.353432] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be updated. [ 804.392465] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.392705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.393042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.393143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.393304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.410937] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: IN_PROGRESS for 2s [ 804.537303] env[65087]: INFO networking_nsxv3.common.synchronization [req-d97fac86-0733-4d2d-be9c-7d3867efab1e req-634b5b1d-38d9-482d-aabc-0e506b58b744 service nova] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_rules [ 804.538107] env[65087]: INFO networking_nsxv3.common.synchronization [req-d97fac86-0733-4d2d-be9c-7d3867efab1e req-634b5b1d-38d9-482d-aabc-0e506b58b744 service nova] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 804.538107] env[65087]: INFO networking_nsxv3.common.synchronization [req-d97fac86-0733-4d2d-be9c-7d3867efab1e req-634b5b1d-38d9-482d-aabc-0e506b58b744 service nova] Enqueued Resource ID: 6eb2e786-d48c-46b1-a98a-5dd089146a7f with Priority: HIGHEST for action port [ 804.539009] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_rules [ 804.539224] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 804.539394] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb2e786-d48c-46b1-a98a-5dd089146a7f with Priority: HIGHEST for action port [ 804.539743] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.539925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.540017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.540233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.540350] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.541929] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.542103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.542302] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eb2e786-d48c-46b1-a98a-5dd089146a7f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.542441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eb2e786-d48c-46b1-a98a-5dd089146a7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.542518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eb2e786-d48c-46b1-a98a-5dd089146a7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.542711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eb2e786-d48c-46b1-a98a-5dd089146a7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.542881] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb2e786-d48c-46b1-a98a-5dd089146a7f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.607514] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: SUCCESS [ 804.607782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.029327] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e38df862-3877-4fbb-b2b8-8702550f272a in Status: SUCCESS [ 805.029597] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e38df862-3877-4fbb-b2b8-8702550f272a deletion is rescheduled due to dependency. [ 805.029742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e38df862-3877-4fbb-b2b8-8702550f272a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.045533] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.045857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.046686] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6eb2e786-d48c-46b1-a98a-5dd089146a7f with status ACTIVE [ 805.046903] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.047091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.047180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.047385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.047492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.047882] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.048388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.048388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.048388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.048388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.048739] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.048856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.048920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.049198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.049288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.049383] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6eb2e786-d48c-46b1-a98a-5dd089146a7f is going to be updated. [ 805.074183] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.074381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.074425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.074607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.074745] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.074972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eb2e786-d48c-46b1-a98a-5dd089146a7f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.231729] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.231891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.231953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.232653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.232776] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.736073] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.240221] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.426055] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 806.426055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.426055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.426055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.426055] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.426055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.426055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.426736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.426736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.426736] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.744728] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 806.745159] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 806.928748] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.434170] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.635903] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.636093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.636136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.636341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.652651] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 807.655277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.657321] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 807.688729] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.688729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.688935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.691311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.700422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.702201] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 807.702201] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 807.702201] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 807.747249] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.747249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.747249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.747249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.749276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.750039] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 807.854021] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.854021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.854021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.854021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.854021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.854536] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 807.937940] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.938187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.938282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.939393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.939393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.939393] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be updated. [ 807.947578] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.947871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.948039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.948390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.949555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.949555] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 807.949555] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'dbf33eac-b2a3-4597-bef7-45961c5c9915', '8ae9556d-2824-4426-9646-69904ca4036b', 'df9bb938-6d5d-4fc7-8385-f402075d6859', '1ca8f202-29e2-429e-9fd1-0f8cb9990f6f', '5f88e35f-7b40-44fd-9e5c-aaf73083cdd5', '0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3', 'd32cda0b-8a2f-42b1-8b70-9028c276b777', '82006ff4-e51b-42b0-a24d-bbd2eef044f1', '9e16ad16-0de9-45ee-937f-dc86cca17f4d', 'cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68', '0cdd684c-5a6e-4834-b6e5-a34e0caee842', '75619e08-1842-4450-8de1-688a542e6f15', 'bf51869e-19e4-466b-9282-9b2c63589cff', 'e065c34d-9c70-483b-a4fb-2d44a853cbeb', '2cf2092a-b6aa-4737-bb3b-7a427e49d9f8', 'f3411048-5318-4245-bd13-ad8c65f4de91', '660ead40-fb4f-4eb7-87db-4a7944439f26', '14277918-93e7-4b1d-8bdd-a2eb46c04cdd', '2126c2c0-a62d-4c6c-90c5-6f0bd003f23b', 'dfdf2f79-21d5-4965-8e78-ad3b2c69cebf', 'd11ae3e7-68e0-48ab-9cf6-d1803117fc1f', 'f44c5dff-d003-41a8-874e-8ad81c2de7ca', '4299363c-8eac-44c8-95f4-12c59a4c43bb', '8adf627f-6f53-4e8f-bb06-db2aedef22fc', '56b74809-473d-4b46-a128-e8953c39feab', '6b5dadcb-8f3a-482e-b14c-24a6ef163d88', 'ae0af2af-9718-4a7b-876d-92e1124cdbd2', '02feb9e5-0f08-496b-8186-408b46050c5d', 'e56f2582-99a0-4048-840f-b0950b64562f', '851d68f8-1229-406c-ac33-c91b60c34ee0', '078ba4a4-0e86-4b25-838d-1fc110729dbd', 'ac3c0a5a-197c-4c4c-a82b-9342302fe922', '2fb66ad5-69f7-466f-94b1-24f53af1b70c', 'de120ad0-cbd8-47c5-85f0-73d798da60f8', 'e38df862-3877-4fbb-b2b8-8702550f272a', 'aa843f83-ade7-475f-9e86-d1f12b4e1f38', '082fc1a8-0a58-4162-926b-fe01957908a7', 'a5fd4ec2-d6c3-4894-bd80-751b7e6176d6', '0521b23b-9dcc-40b0-a1c4-32590b372bcd', 'a6dd9b03-d553-4b7a-b9f5-f9e3b715daba', '43a553ce-6692-41a3-ab44-fe5b38b80d7f', '0756d72c-9df8-4861-9190-090f401edeb6'} {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 807.949555] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 807.969639] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.969858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.969966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.970221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.970310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.970433] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 807.970506] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 807.970822] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 807.980533] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.980533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.980697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.980764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.980911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.992499] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: IN_PROGRESS for 2s [ 808.061284] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.061284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.061284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.061284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.061284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.061284] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 808.061284] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 808.061284] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 808.061284] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 808.061284] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 808.061284] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGH for action security_group_rules [ 808.061284] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGH for action security_group_rules [ 808.061284] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGH for action security_group_rules [ 808.061284] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGH for action security_group_rules [ 808.061284] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGH for action security_group_rules [ 808.061284] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGH for action security_group_rules [ 808.062398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.318558] env[65087]: INFO networking_nsxv3.common.synchronization [req-dba57cbb-0612-4edb-b689-85fab2a5e80b req-74e7e291-a08f-435c-a674-f8403df25727 tempest-ServersAdminTestJSON-1882897549 tempest-ServersAdminTestJSON-1882897549-project-member] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 808.319213] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 808.319374] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGH for action security_group_rules [ 808.319495] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9bb938-6d5d-4fc7-8385-f402075d6859 with Priority: HIGH for action security_group_rules [ 808.319600] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGH for action security_group_rules [ 808.319708] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 with Priority: HIGH for action security_group_rules [ 808.319805] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf with Priority: HIGH for action security_group_rules [ 808.319897] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b with Priority: HIGH for action security_group_rules [ 808.319999] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd with Priority: HIGH for action security_group_rules [ 808.320103] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 with Priority: HIGH for action security_group_rules [ 808.320192] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb with Priority: HIGH for action security_group_rules [ 808.320299] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGH for action security_group_rules [ 808.320389] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf51869e-19e4-466b-9282-9b2c63589cff with Priority: HIGH for action security_group_rules [ 808.320474] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75619e08-1842-4450-8de1-688a542e6f15 with Priority: HIGH for action security_group_rules [ 808.320559] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGH for action security_group_rules [ 808.320643] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 with Priority: HIGH for action security_group_rules [ 808.320738] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d with Priority: HIGH for action security_group_rules [ 808.320827] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGH for action security_group_rules [ 808.320916] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGH for action security_group_rules [ 808.321039] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 with Priority: HIGH for action security_group_rules [ 808.321185] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGH for action security_group_rules [ 808.321282] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGH for action security_group_rules [ 808.321588] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.321803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.321889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.322113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.322289] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.322394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.322458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.322628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.322728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.322824] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.323830] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.324319] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.324319] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.324568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.325958] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.325958] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df9bb938-6d5d-4fc7-8385-f402075d6859 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.327092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.327373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.327547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.327667] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df9bb938-6d5d-4fc7-8385-f402075d6859',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.328489] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.328603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.328688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.328887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.328960] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.329907] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.329907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.330052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.330089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.330162] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cf2092a-b6aa-4737-bb3b-7a427e49d9f8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.335058] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.335058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.335058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.335058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.335058] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfdf2f79-21d5-4965-8e78-ad3b2c69cebf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.335058] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.335058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.335058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.335058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.335440] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2126c2c0-a62d-4c6c-90c5-6f0bd003f23b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.336732] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.336869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.337153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.337235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.337276] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14277918-93e7-4b1d-8bdd-a2eb46c04cdd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.338346] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-660ead40-fb4f-4eb7-87db-4a7944439f26 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.338451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.338532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.338686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.338931] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('660ead40-fb4f-4eb7-87db-4a7944439f26',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.340832] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.341488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.341488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.341488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.341488] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e065c34d-9c70-483b-a4fb-2d44a853cbeb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.343238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.343394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.343455] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.343609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.343683] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.343973] env[65087]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 808.345616] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf51869e-19e4-466b-9282-9b2c63589cff taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.345616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.345616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.345821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.345893] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf51869e-19e4-466b-9282-9b2c63589cff',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.347366] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75619e08-1842-4450-8de1-688a542e6f15 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.347366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.347366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.347366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.347724] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75619e08-1842-4450-8de1-688a542e6f15',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.349724] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.349724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.349724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.349724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.349724] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.350116] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.350116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.350203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.350322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.350389] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.351310] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.351454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.351526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.351684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.353080] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e16ad16-0de9-45ee-937f-dc86cca17f4d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.353121] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.353233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.353273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.353498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.353995] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.355765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.355765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.355765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.355765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.355765] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.358136] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.358136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.358136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.358136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.358136] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5f88e35f-7b40-44fd-9e5c-aaf73083cdd5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.358136] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.358534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.358534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.358534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.358534] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.359395] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.359526] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.360978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.360978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.360978] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.360978] env[65087]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 808.367097] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.368426] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.368535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.368598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.369385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.369385] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.369385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.369385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.369385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.369385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.369385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.369664] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.400177] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.400426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.400426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.400602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.437192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.437192] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df9bb938-6d5d-4fc7-8385-f402075d6859 is going to be deleted. [ 808.508401] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.509029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.509496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.509737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.509867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.509991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df9bb938-6d5d-4fc7-8385-f402075d6859" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.793758] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-354 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.794077] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.795037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.795037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.795037] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.795037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.795037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.795509] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.795721] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.795990] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.796224] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.796394] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.796550] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.796720] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.796874] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.797067] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.816772] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.816958] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.817117] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.817292] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-354" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.817621] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-3a5108f9-28fd-46d0-b680-d2aad36981a4 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.817791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-3a5108f9-28fd-46d0-b680-d2aad36981a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.817905] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-3a5108f9-28fd-46d0-b680-d2aad36981a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.818286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-3a5108f9-28fd-46d0-b680-d2aad36981a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.818430] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a5108f9-28fd-46d0-b680-d2aad36981a4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.863095] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.863095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.863095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.863536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.863759] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.864102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.864285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.864648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.864736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.864896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.869535] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.874527] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.881620] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.881620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.881830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.882378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.882378] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.882378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.882378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.882602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.882863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.882863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.883116] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.883365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.883488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.883711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.883948] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.884124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.884233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.884442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.884618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.884764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.884910] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.912301] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.912379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.917297] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.917426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.917485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.918238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.918238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.918238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.918238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.918238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.918639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.918639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.918639] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.921016] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.921016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.921016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.921016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.921016] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.921016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.921016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.921016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.921016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.921016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.921016] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.924375] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.924375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.924375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.924375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.925519] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.925519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.925519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.925519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.925519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.925767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.925767] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.929869] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.930017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.930100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.930301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.930508] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.930611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.930675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.930827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.930913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.931012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.931102] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.945380] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.945556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.945600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.945806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.948582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.948696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.951068] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.978660] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.979909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.992836] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.992994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.993840] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.994015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.994668] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.994762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.995632] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.995731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.996438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.996534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.997685] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.997840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.998471] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.998567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.999258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.999368] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf51869e-19e4-466b-9282-9b2c63589cff is going to be deleted. [ 809.000830] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.000944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.001033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.001279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.004110] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.004292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.025058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.025058] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 660ead40-fb4f-4eb7-87db-4a7944439f26 is going to be deleted. [ 809.026504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.026504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.045397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.045537] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5f88e35f-7b40-44fd-9e5c-aaf73083cdd5 is going to be deleted. [ 809.046449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.046665] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.069732] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.069866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.074449] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.074558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.075377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.075495] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2126c2c0-a62d-4c6c-90c5-6f0bd003f23b is going to be deleted. [ 809.076392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.076590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.096056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.096056] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14277918-93e7-4b1d-8bdd-a2eb46c04cdd is going to be deleted. [ 809.096818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.097059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.099155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.099276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.121042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.121042] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e16ad16-0de9-45ee-937f-dc86cca17f4d is going to be deleted. [ 809.121512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.121972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.178680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.178853] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfdf2f79-21d5-4965-8e78-ad3b2c69cebf is going to be deleted. [ 809.180122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.180122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.208970] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.208970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.241303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.241303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.249167] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.249325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.263649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.263924] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be deleted. [ 809.265138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.265639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.312488] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.312698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.322358] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.322610] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.322738] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.323047] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.323217] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.323371] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 3a5108f9-28fd-46d0-b680-d2aad36981a4 not found, creating... [ 809.324098] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.324304] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.324426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.324718] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.324946] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.325322] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.325488] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.325617] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.325862] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.326013] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.326182] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 3a5108f9-28fd-46d0-b680-d2aad36981a4 is going to be created. [ 809.333782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.334127] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cf2092a-b6aa-4737-bb3b-7a427e49d9f8 is going to be deleted. [ 809.335450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.335723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.371879] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.372359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.372359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.372702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.372702] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.372873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.373134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.373196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.373295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.373815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.373815] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.373815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.374419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.374419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.374419] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.374748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.374748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.374748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.374942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.375110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.375254] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.376472] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.376611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.376699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.376914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.377077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.377215] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 809.381061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.381061] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68 is going to be deleted. [ 809.381436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.381663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.387045] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d32cda0b-8a2f-42b1-8b70-9028c276b777: rpc.has_security_group_logging(os_id): False [ 809.416656] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.416966] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.417119] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.417527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.418388] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.418694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-3a5108f9-28fd-46d0-b680-d2aad36981a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.428250] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.428757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.446048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.446234] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75619e08-1842-4450-8de1-688a542e6f15 is going to be deleted. [ 809.447567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.447881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.449365] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.452043] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.452581] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.454767] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.454930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.455254] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3: rpc.has_security_group_logging(os_id): False [ 809.472851] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.473054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.473163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.473507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.473688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.481176] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.481396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.482260] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.482411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.486038] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 809.488372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.488515] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e065c34d-9c70-483b-a4fb-2d44a853cbeb is going to be deleted. [ 809.489465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.489699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.489804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.489926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf51869e-19e4-466b-9282-9b2c63589cff" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.490100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.490272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.490354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.490492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-660ead40-fb4f-4eb7-87db-4a7944439f26" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.491292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.491292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.491427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.491427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5f88e35f-7b40-44fd-9e5c-aaf73083cdd5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.491572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.491720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.491803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.491919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2126c2c0-a62d-4c6c-90c5-6f0bd003f23b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.492080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.492225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.492301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.492430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14277918-93e7-4b1d-8bdd-a2eb46c04cdd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.492556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.492709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.492786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.492898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e16ad16-0de9-45ee-937f-dc86cca17f4d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.493048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.493190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.493284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.493395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfdf2f79-21d5-4965-8e78-ad3b2c69cebf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.493522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.493677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.507945] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.508150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.563647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.564116] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.564291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.564368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.565135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.565135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.565135] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.565320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.565320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.565460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.565555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.565811] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.565902] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.565966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.566201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.566277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.566422] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be updated. [ 809.567924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.568176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.568287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.568423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.568663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.568850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.568945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.570724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cf2092a-b6aa-4737-bb3b-7a427e49d9f8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.571854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.571854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.625324] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.625440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.651218] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.651451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.658885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.659169] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.659292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.659361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.659628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.659727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.659840] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 is going to be updated. [ 809.661963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.662260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.662463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.662606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb656c2d-8a30-4e3d-b0f3-2e52ffa77a68" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.662799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.662921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.663032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.663165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75619e08-1842-4450-8de1-688a542e6f15" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.663271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.663428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.663504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.663971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e065c34d-9c70-483b-a4fb-2d44a853cbeb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.766703] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.766939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.767119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.767446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.767682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.784062] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.784248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.784288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.784520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.784676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.861519] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: IN_PROGRESS for 2s [ 809.862415] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 809.863124] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 in Status: IN_PROGRESS for 2s [ 809.880041] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbf33eac-b2a3-4597-bef7-45961c5c9915: rpc.has_security_group_logging(os_id): False [ 809.911957] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.912175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.913089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.913089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.951190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.951503] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.951674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.951808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.952072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.952198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.952763] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.952763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.952763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.952763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.952926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.953025] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.953444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.953509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.953657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.953738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.953829] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be updated. [ 809.955444] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3411048-5318-4245-bd13-ad8c65f4de91: rpc.has_security_group_logging(os_id): False [ 809.956527] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82006ff4-e51b-42b0-a24d-bbd2eef044f1: rpc.has_security_group_logging(os_id): False [ 809.958100] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ae9556d-2824-4426-9646-69904ca4036b: rpc.has_security_group_logging(os_id): False [ 809.987502] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.987502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.987502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.987502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.989044] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.989382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.010261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.010261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.010261] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 810.010261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.010261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.010261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.010261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.010261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.011601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.012141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.012444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.012677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.012934] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.021811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.021811] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.021811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.021811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.021811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.021811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.021811] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 810.021811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.023474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.046399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.046752] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.046857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.046926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.047151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.047238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.048063] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ae9556d-2824-4426-9646-69904ca4036b is going to be updated. [ 810.048453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.048632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.078289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.078604] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.078733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.078801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.079028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.079112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.079261] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 is going to be updated. [ 810.105862] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.106051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.106162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.106444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.106626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.115393] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.115487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.115557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.115758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.115901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.118872] env[65087]: INFO networking_nsxv3.common.synchronization [req-dba57cbb-0612-4edb-b689-85fab2a5e80b req-c6519db7-23f2-4d5d-a664-d2676622cbaf service nova] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_rules [ 810.119066] env[65087]: INFO networking_nsxv3.common.synchronization [req-dba57cbb-0612-4edb-b689-85fab2a5e80b req-c6519db7-23f2-4d5d-a664-d2676622cbaf service nova] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 810.119202] env[65087]: INFO networking_nsxv3.common.synchronization [req-dba57cbb-0612-4edb-b689-85fab2a5e80b req-c6519db7-23f2-4d5d-a664-d2676622cbaf service nova] Enqueued Resource ID: 3a5108f9-28fd-46d0-b680-d2aad36981a4 with Priority: HIGHEST for action port [ 810.119708] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_rules [ 810.119836] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 810.119929] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a5108f9-28fd-46d0-b680-d2aad36981a4 with Priority: HIGHEST for action port [ 810.120424] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.120548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.120761] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.120847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.121135] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a5108f9-28fd-46d0-b680-d2aad36981a4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.121135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a5108f9-28fd-46d0-b680-d2aad36981a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.121332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a5108f9-28fd-46d0-b680-d2aad36981a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.121368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a5108f9-28fd-46d0-b680-d2aad36981a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.121443] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a5108f9-28fd-46d0-b680-d2aad36981a4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.141094] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 810.141954] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: IN_PROGRESS for 2s [ 810.217232] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.217391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.217467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.217697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.217884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.236309] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.236514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.236560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.236747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.236896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.248090] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: IN_PROGRESS for 2s [ 810.276953] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 in Status: IN_PROGRESS for 2s [ 810.515611] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.515772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.515824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.516175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.516258] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.516334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.516397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.516557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.516678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.516733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.516913] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.517013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.517074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.517223] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.517369] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.517464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.517520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.518451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.518451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.518451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.518451] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.626417] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a5108f9-28fd-46d0-b680-d2aad36981a4 with status ACTIVE [ 810.626652] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.626786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.626853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.627087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.627380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.627380] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.627666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.627666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.627666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.627755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.627912] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.627963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.628028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.628172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.629051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.629051] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a5108f9-28fd-46d0-b680-d2aad36981a4 is going to be updated. [ 810.649035] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.649199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.649282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.649493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.649625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.649781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a5108f9-28fd-46d0-b680-d2aad36981a4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.020417] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa843f83-ade7-475f-9e86-d1f12b4e1f38: rpc.has_security_group_logging(os_id): False [ 811.040938] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.041094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.041170] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.041389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.063241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.063752] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.063752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.063912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.064163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.064321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.064627] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.064736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.064802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.065013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.065116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.065498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.065625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.065692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.065842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.065921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.066031] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be updated. [ 811.136655] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.136655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.136655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.136655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.137271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.158077] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: IN_PROGRESS for 2s [ 811.499826] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 811.499826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.499826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.499826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.499826] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.499826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.499826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.501154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.501154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.501154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.501154] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.502793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.503673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.504925] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.504925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.505292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.505867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.505963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.506153] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.744874] env[65087]: INFO networking_nsxv3.common.synchronization [None req-48be51b8-15ca-4e9f-bbdd-8c7e656b3cd9 None None] Enqueued Resource ID: 36be8c8f-8796-4999-b8c4-9019d8752e36 with Priority: HIGHEST for action port [ 811.745869] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36be8c8f-8796-4999-b8c4-9019d8752e36 with Priority: HIGHEST for action port [ 811.746805] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-36be8c8f-8796-4999-b8c4-9019d8752e36 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.746967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36be8c8f-8796-4999-b8c4-9019d8752e36" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.747094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36be8c8f-8796-4999-b8c4-9019d8752e36" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.747566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36be8c8f-8796-4999-b8c4-9019d8752e36" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.747659] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36be8c8f-8796-4999-b8c4-9019d8752e36',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.885510] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 in Status: SUCCESS [ 811.885838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.886931] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: SUCCESS [ 811.887213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.010954] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.011078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.011783] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.159327] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 812.159709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.160857] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 812.160857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.255793] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36be8c8f-8796-4999-b8c4-9019d8752e36 [ 812.256031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.256397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.256397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.256509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.256509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.256732] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36be8c8f-8796-4999-b8c4-9019d8752e36 already deleted. [ 812.256732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36be8c8f-8796-4999-b8c4-9019d8752e36" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.271773] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: SUCCESS [ 812.271773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.307531] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 in Status: SUCCESS [ 812.307531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.516141] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.781256] env[65087]: INFO networking_nsxv3.common.synchronization [req-d55b0a66-5f68-4033-a5ee-32198ee9d7a3 req-cfd1816e-1301-435f-9927-14957e9e24ec tempest-ServerRescueTestJSON-1537167573 tempest-ServerRescueTestJSON-1537167573-project-member] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 812.781256] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 812.781256] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.782289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.782405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.783351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.783545] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.783660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.783727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.783971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.784098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.784200] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.018374] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.018567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.019072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.019072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.019072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.019072] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 813.057290] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.057447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.057493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.057719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.057965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.074774] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 813.179805] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 813.182083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.238381] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.238589] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-52" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.238729] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-52" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.239107] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-52" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.239445] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.239591] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.239709] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.240337] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.240337] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.240479] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.240479] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.240587] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.240702] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.240833] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.240924] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.241064] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.265710] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.265911] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 813.266083] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.266300] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-52" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.266638] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-2c62dcd9-eddd-4f39-ab9d-680a36f91228 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.266905] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-2c62dcd9-eddd-4f39-ab9d-680a36f91228" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.266905] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-2c62dcd9-eddd-4f39-ab9d-680a36f91228" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.267291] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-2c62dcd9-eddd-4f39-ab9d-680a36f91228" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.267431] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c62dcd9-eddd-4f39-ab9d-680a36f91228',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.289496] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.289739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.289739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.289940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.290030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.290499] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.290499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.290499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.290798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.290798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.290798] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be already deleted. [ 813.290798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.771066] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.771366] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.771492] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.771879] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.772124] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.772378] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 2c62dcd9-eddd-4f39-ab9d-680a36f91228 not found, creating... [ 813.772634] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.772823] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.772978] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.773378] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.773558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.774013] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.774237] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.774382] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.774660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.774799] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.775008] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 2c62dcd9-eddd-4f39-ab9d-680a36f91228 is going to be created. [ 813.800768] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.801424] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.801590] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.801891] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.802443] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.802706] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-2c62dcd9-eddd-4f39-ab9d-680a36f91228" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.605863] env[65087]: INFO networking_nsxv3.common.synchronization [req-d55b0a66-5f68-4033-a5ee-32198ee9d7a3 req-ef4ed408-8c60-435e-9bb0-dd72d12d354b service nova] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_rules [ 814.606239] env[65087]: INFO networking_nsxv3.common.synchronization [req-d55b0a66-5f68-4033-a5ee-32198ee9d7a3 req-ef4ed408-8c60-435e-9bb0-dd72d12d354b service nova] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 814.606239] env[65087]: INFO networking_nsxv3.common.synchronization [req-d55b0a66-5f68-4033-a5ee-32198ee9d7a3 req-ef4ed408-8c60-435e-9bb0-dd72d12d354b service nova] Enqueued Resource ID: 2c62dcd9-eddd-4f39-ab9d-680a36f91228 with Priority: HIGHEST for action port [ 814.607154] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_rules [ 814.607154] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 814.609107] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c62dcd9-eddd-4f39-ab9d-680a36f91228 with Priority: HIGHEST for action port [ 814.609107] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.609107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.609107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.609107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.609107] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.609991] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.610127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.610212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.610415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.610555] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.610751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.610751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.610889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.610930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.611018] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.615838] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c62dcd9-eddd-4f39-ab9d-680a36f91228 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.615838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c62dcd9-eddd-4f39-ab9d-680a36f91228" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.615838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c62dcd9-eddd-4f39-ab9d-680a36f91228" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.615838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c62dcd9-eddd-4f39-ab9d-680a36f91228" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.615838] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c62dcd9-eddd-4f39-ab9d-680a36f91228',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.090884] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 815.090884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.090884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.090884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.091055] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.091106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.091205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.091342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.091428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.091524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.091692] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.091892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.092072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.092240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.092397] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.092492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.092937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.092937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.092937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.092937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.093139] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.117531] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.117720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.117886] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.118763] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c62dcd9-eddd-4f39-ab9d-680a36f91228 with status ACTIVE [ 815.118941] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.119063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.119128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.119333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.119417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.119723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.119723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.119723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.120013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.120013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.120121] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.120225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.120325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.120456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.120456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.120956] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c62dcd9-eddd-4f39-ab9d-680a36f91228 is going to be updated. [ 815.158939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.160239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.160239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.162050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.162050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.162050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c62dcd9-eddd-4f39-ab9d-680a36f91228" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.458751] env[65087]: INFO networking_nsxv3.common.synchronization [None req-6b5f5a45-4e4a-411b-b26c-0e69416d228c None None] Enqueued Resource ID: 10473f23-4a49-48ea-9fe3-d862789f9748 with Priority: HIGHEST for action port [ 815.459514] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10473f23-4a49-48ea-9fe3-d862789f9748 with Priority: HIGHEST for action port [ 815.461352] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-10473f23-4a49-48ea-9fe3-d862789f9748 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.461352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10473f23-4a49-48ea-9fe3-d862789f9748" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.461352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10473f23-4a49-48ea-9fe3-d862789f9748" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.461352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10473f23-4a49-48ea-9fe3-d862789f9748" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.461352] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10473f23-4a49-48ea-9fe3-d862789f9748',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.595937] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f: rpc.has_security_group_logging(os_id): False [ 815.618117] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.618117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.618117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.618117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.624182] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.643918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.644362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.644499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.644583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.644843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.644920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.645293] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.645293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.645431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.645577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.645659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.645875] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.646450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.646610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.646834] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.646926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.647036] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 815.697300] env[65087]: INFO networking_nsxv3.common.synchronization [req-38b6eae7-6590-4858-bb1b-5bc4d5cebade req-dcbd1f35-4a2a-4ee3-be99-b491eaef530e tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 815.700840] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 815.701730] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.702063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.702063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.702242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.702455] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.702797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.702797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.702797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.703062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.703062] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.764475] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.764615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.764725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.764959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.765262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.791259] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 815.964848] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 10473f23-4a49-48ea-9fe3-d862789f9748 [ 815.964848] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.964848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.964848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.964848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.964848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.964848] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:10473f23-4a49-48ea-9fe3-d862789f9748 already deleted. [ 815.964848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10473f23-4a49-48ea-9fe3-d862789f9748" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.133187] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.133187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.133187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.133187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.133187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.133187] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be is going to be created. [ 816.173027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.173027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.173027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.173027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.173027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.198493] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: UNINITIALIZED for 2s [ 816.207616] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.214864] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.215323] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.215323] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.215755] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.216066] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.216153] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.216311] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.216797] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.216797] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.217134] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.217134] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.217230] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.217317] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.217426] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.217502] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.217634] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.256030] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.256030] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.256030] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.256030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.256030] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.256030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.256030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.257125] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.257481] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.720083] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.760824] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.761246] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.761371] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.762109] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.762109] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.762248] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98 not found, creating... [ 816.762466] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.762665] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.762820] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.763105] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.763302] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.763603] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.763829] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.763967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.764201] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.764339] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.764479] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98 is going to be created. [ 816.788403] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.788681] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.788836] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.789170] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.789411] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.789638] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.145532] env[65087]: INFO networking_nsxv3.common.synchronization [req-6acf0e93-a1d5-4a70-9046-ddb10e889eda req-44785af7-6fbf-45bc-8d9a-da0a152cb334 tempest-ServersNegativeTestJSON-734531957 tempest-ServersNegativeTestJSON-734531957-project-member] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 817.146681] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 817.148414] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.148414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.148414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.148414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.148414] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.148731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.148731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.148877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.149736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.149830] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.222065] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.222253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.222314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.222927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.222927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.222927] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 817.264360] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.264360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.264360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.264629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.264692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.274398] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 817.520699] env[65087]: INFO networking_nsxv3.common.synchronization [req-38b6eae7-6590-4858-bb1b-5bc4d5cebade req-877c59d9-bc96-4a71-9eed-e2fdcecee711 service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 817.520863] env[65087]: INFO networking_nsxv3.common.synchronization [req-38b6eae7-6590-4858-bb1b-5bc4d5cebade req-877c59d9-bc96-4a71-9eed-e2fdcecee711 service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 817.520994] env[65087]: INFO networking_nsxv3.common.synchronization [req-38b6eae7-6590-4858-bb1b-5bc4d5cebade req-877c59d9-bc96-4a71-9eed-e2fdcecee711 service nova] Enqueued Resource ID: bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98 with Priority: HIGHEST for action port [ 817.521638] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 817.521773] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 817.521871] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98 with Priority: HIGHEST for action port [ 817.525581] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.525581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.525581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.525581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.525581] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.525581] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.525581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.525581] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.526078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.526078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.526078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.526078] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.653122] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.806842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 817.806842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.806842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.806842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.807353] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.033506] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.033506] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98 with status ACTIVE [ 818.033506] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.033506] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.033506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.033506] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.034255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.034255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.034255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.034255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.034255] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98 is going to be updated. [ 818.066560] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.066708] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.066814] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.067342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.067342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.067342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb3ff837-c28f-44a2-8ca0-5e9fe4d0ab98" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.155673] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.209768] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: SUCCESS [ 818.209768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.209768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.209910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.210062] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.210180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.210249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.210420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.210507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.210592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.210683] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.310368] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.310626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.310714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.311060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.311257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.311378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.311451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.311629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.311717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.311803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.311925] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.658075] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.658286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.658376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.658649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.658783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.658892] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be updated. [ 818.709860] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.710062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.710218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.710444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.710602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.713485] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.713705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.713705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.713921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.714213] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.714356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.714356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.714512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.714607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.714703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.714856] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.714970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.715151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.715224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.715357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.715449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.715509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.715648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.715724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.715806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.715896] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.729408] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: IN_PROGRESS for 2s [ 818.817532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.817840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.817840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.818349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.818582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.819521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.819521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.819521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.819521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.819521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.819521] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.820065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.820286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.820495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.820692] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.820839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.820909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.821079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.821158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.821244] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.821334] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.217899] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e03b40fb-01ef-40a2-8d18-b763e5ce28be: rpc.has_security_group_logging(os_id): False [ 819.249486] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.249486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.250505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.250505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.250505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.250505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.250505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.250505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.250505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.250894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.250894] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.250894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.251034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.251130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.251224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.251440] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.251532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.251621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.251778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.251878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.251982] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be is going to be created. [ 819.282777] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 819.283081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.283287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.283631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.283681] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.283864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.283908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.284121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.284259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.284411] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.325489] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f: rpc.has_security_group_logging(os_id): False [ 819.339404] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.339633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.339633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.339840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.340199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.361477] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.361631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.361704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.361914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.361999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.362198] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.363409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.363503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.363679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.363760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.363997] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.364124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.364188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.364379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.364418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.364595] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.368022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.368022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.368022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.369132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.369132] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 819.370536] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: IN_PROGRESS for 2s [ 819.518959] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.518959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.522810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.522810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.522810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.550534] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 819.786922] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.289784] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.742460] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 820.742709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.792622] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.792770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.792770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.792931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.793033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.793212] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 820.828294] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.828445] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.828517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.829519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.829519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.839495] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 821.387557] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: SUCCESS [ 821.387874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.568664] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 821.568981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.522856] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 822.523219] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 822.850141] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 822.850669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.850669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.850811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.851820] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.851820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.851820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.851820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.851820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.851820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.851820] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.360556] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.360779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.360779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.361419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.361419] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.361419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.361419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.361732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.361732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.361732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.361860] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.361912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.361943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.362225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.362363] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.362461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.362584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.362721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.362837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.362953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.363086] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.556248] env[65087]: INFO networking_nsxv3.common.synchronization [None req-4738da70-f363-4a6c-8d57-8d6e243fa2a3 None None] Enqueued Resource ID: 5cb2deb3-034e-41e2-a123-d9fab2d4da5f with Priority: HIGHEST for action port [ 823.556797] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cb2deb3-034e-41e2-a123-d9fab2d4da5f with Priority: HIGHEST for action port [ 823.557195] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cb2deb3-034e-41e2-a123-d9fab2d4da5f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.557338] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cb2deb3-034e-41e2-a123-d9fab2d4da5f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.557427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cb2deb3-034e-41e2-a123-d9fab2d4da5f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.557748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cb2deb3-034e-41e2-a123-d9fab2d4da5f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.558195] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cb2deb3-034e-41e2-a123-d9fab2d4da5f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.868105] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0af2af-9718-4a7b-876d-92e1124cdbd2: rpc.has_security_group_logging(os_id): False [ 823.888717] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.888911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.888991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.889295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.913470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.913784] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.913922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.913982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.914249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.914336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.914544] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.914644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.914711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.918156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.918156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.919440] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.919440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.919440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.919440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.919440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.919440] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 823.995023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.995023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.995023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.995023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.995023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.011367] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 824.062694] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cb2deb3-034e-41e2-a123-d9fab2d4da5f [ 824.062934] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.063097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.063171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.063641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.063766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.063873] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cb2deb3-034e-41e2-a123-d9fab2d4da5f already deleted. [ 824.063959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cb2deb3-034e-41e2-a123-d9fab2d4da5f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.223786] env[65087]: INFO networking_nsxv3.common.synchronization [None req-2e7e250a-ee56-4ad7-b7f2-9f8133a56225 None None] Enqueued Resource ID: 9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1 with Priority: HIGHEST for action port [ 824.224802] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1 with Priority: HIGHEST for action port [ 824.225272] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.225406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.225662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.227716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.227866] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.733954] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1 [ 824.734368] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.734368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.734469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.734597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.734681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.734774] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1 already deleted. [ 824.734851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fa0f5e3-52fb-48d9-9564-41ca7e73d1f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.547287] env[65087]: INFO networking_nsxv3.common.synchronization [req-b4cc954b-65f0-4ab6-b114-34cef2175bee req-692a50eb-541d-455b-962e-d21da9624c46 tempest-ServersTestBootFromVolume-901464301 tempest-ServersTestBootFromVolume-901464301-project-member] Enqueued Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_members [ 825.547287] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_members [ 825.547771] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.547771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.547876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.548466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.548466] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.548466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.548466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.548692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.548896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.548938] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.049781] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 826.050688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.053780] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.053972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.054961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.056795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.056795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.056795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.056795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.056795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.056795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.056795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.057583] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 already deleted. [ 826.057583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.093150] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-704 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.093435] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-704" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.093543] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-704" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.093845] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-704" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.095593] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.095593] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.095844] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.096565] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.096565] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.096768] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.096958] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.097134] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.097264] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.097427] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.097623] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.097787] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.128893] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.129099] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.129258] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.129450] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-704" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.129771] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-0b8692c2-d8bc-4879-9673-83aa6210a05b taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.129961] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-0b8692c2-d8bc-4879-9673-83aa6210a05b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.131980] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-0b8692c2-d8bc-4879-9673-83aa6210a05b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.131980] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-0b8692c2-d8bc-4879-9673-83aa6210a05b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.131980] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b8692c2-d8bc-4879-9673-83aa6210a05b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.515859] env[65087]: INFO networking_nsxv3.common.synchronization [None req-976b137b-6089-4e40-a1a1-4ddc9cf00a26 None None] Enqueued Resource ID: 4e00e869-83c6-443c-9f3e-378a6f23ff62 with Priority: HIGHEST for action port [ 826.516787] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e00e869-83c6-443c-9f3e-378a6f23ff62 with Priority: HIGHEST for action port [ 826.517274] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e00e869-83c6-443c-9f3e-378a6f23ff62 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.517542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e00e869-83c6-443c-9f3e-378a6f23ff62" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.517674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e00e869-83c6-443c-9f3e-378a6f23ff62" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.518019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e00e869-83c6-443c-9f3e-378a6f23ff62" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.518405] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e00e869-83c6-443c-9f3e-378a6f23ff62',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.635331] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.635331] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.635736] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.635736] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.635852] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.636214] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 0b8692c2-d8bc-4879-9673-83aa6210a05b not found, creating... [ 826.636327] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.636485] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.636882] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.636882] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.637034] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.638231] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.638231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.638231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.638231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.638231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.638231] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 0b8692c2-d8bc-4879-9673-83aa6210a05b is going to be created. [ 826.669387] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.669387] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.669387] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.669387] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.669387] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.669704] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-0b8692c2-d8bc-4879-9673-83aa6210a05b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.023874] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e00e869-83c6-443c-9f3e-378a6f23ff62 [ 827.024716] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.027550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.027668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.027860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.027955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.028740] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e00e869-83c6-443c-9f3e-378a6f23ff62 already deleted. [ 827.028740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e00e869-83c6-443c-9f3e-378a6f23ff62" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.684893] env[65087]: INFO networking_nsxv3.common.synchronization [None req-7bd97e67-6dc3-4270-bfa2-ff5a3c1849dd None None] Enqueued Resource ID: a0d37eac-2952-4c1a-9f47-8c42c64810b4 with Priority: HIGHEST for action port [ 827.685903] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0d37eac-2952-4c1a-9f47-8c42c64810b4 with Priority: HIGHEST for action port [ 827.687249] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0d37eac-2952-4c1a-9f47-8c42c64810b4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.687702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0d37eac-2952-4c1a-9f47-8c42c64810b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.687702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0d37eac-2952-4c1a-9f47-8c42c64810b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.687957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0d37eac-2952-4c1a-9f47-8c42c64810b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.688060] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0d37eac-2952-4c1a-9f47-8c42c64810b4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.696418] env[65087]: INFO networking_nsxv3.common.synchronization [req-b4cc954b-65f0-4ab6-b114-34cef2175bee req-8d299c8f-eb26-4990-ad7d-0aa282ba9ec4 service nova] Enqueued Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_rules [ 827.696683] env[65087]: INFO networking_nsxv3.common.synchronization [req-b4cc954b-65f0-4ab6-b114-34cef2175bee req-8d299c8f-eb26-4990-ad7d-0aa282ba9ec4 service nova] Enqueued Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_members [ 827.696952] env[65087]: INFO networking_nsxv3.common.synchronization [req-b4cc954b-65f0-4ab6-b114-34cef2175bee req-8d299c8f-eb26-4990-ad7d-0aa282ba9ec4 service nova] Enqueued Resource ID: 0b8692c2-d8bc-4879-9673-83aa6210a05b with Priority: HIGHEST for action port [ 827.697703] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_rules [ 827.697813] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_members [ 827.697999] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8692c2-d8bc-4879-9673-83aa6210a05b with Priority: HIGHEST for action port [ 827.698339] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.698498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.698580] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.698901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.698901] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.699934] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.700097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.700190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.700417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.700632] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.700795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.700875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.701262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.701262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.703807] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.704885] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b8692c2-d8bc-4879-9673-83aa6210a05b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.705078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b8692c2-d8bc-4879-9673-83aa6210a05b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.705182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b8692c2-d8bc-4879-9673-83aa6210a05b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.705815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b8692c2-d8bc-4879-9673-83aa6210a05b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.705815] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b8692c2-d8bc-4879-9673-83aa6210a05b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.190227] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0d37eac-2952-4c1a-9f47-8c42c64810b4 [ 828.190477] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.190615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.190682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.190895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.191477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.191477] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0d37eac-2952-4c1a-9f47-8c42c64810b4 already deleted. [ 828.191477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0d37eac-2952-4c1a-9f47-8c42c64810b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.209045] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.209978] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.210145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.210696] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b8692c2-d8bc-4879-9673-83aa6210a05b with status ACTIVE [ 828.210976] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.211341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.212112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.212490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.212624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.212877] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.212987] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.213120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.213242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.213324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.213592] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.213718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.213781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.214490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.214490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.214490] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b8692c2-d8bc-4879-9673-83aa6210a05b is going to be updated. [ 828.239281] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.239476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.239546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.239730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.239873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.240109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b8692c2-d8bc-4879-9673-83aa6210a05b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.711685] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.214972] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.216225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.216225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.216225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.216505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.216505] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 is going to be created. [ 829.248989] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.249276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.249343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.249675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.249891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.263057] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 in Status: UNINITIALIZED for 2s [ 831.281865] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 in Status: SUCCESS [ 831.282259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.282413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.282694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.282966] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.283173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.283252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.283406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.283748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.283748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.283748] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.786277] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.289383] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667: rpc.has_security_group_logging(os_id): False [ 832.317383] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.317647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.317647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.317922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.318032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.318300] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.318508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.318508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.318717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.318755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.319037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 is going to be created. [ 832.418947] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.419159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.419159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.419636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.419636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.436147] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 in Status: IN_PROGRESS for 2s [ 832.700711] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 832.700711] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 834.453845] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 in Status: SUCCESS [ 834.454374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.450975] env[65087]: INFO networking_nsxv3.common.synchronization [None req-1c31dbc9-bc97-427c-9669-52276ef097db None None] Enqueued Resource ID: 80b55fa4-94b0-4650-914a-ab8a9b2de890 with Priority: HIGHEST for action port [ 837.451373] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80b55fa4-94b0-4650-914a-ab8a9b2de890 with Priority: HIGHEST for action port [ 837.451715] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-80b55fa4-94b0-4650-914a-ab8a9b2de890 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.451858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80b55fa4-94b0-4650-914a-ab8a9b2de890" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.451928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80b55fa4-94b0-4650-914a-ab8a9b2de890" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.453341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80b55fa4-94b0-4650-914a-ab8a9b2de890" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.453341] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80b55fa4-94b0-4650-914a-ab8a9b2de890',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.956514] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80b55fa4-94b0-4650-914a-ab8a9b2de890 [ 837.956862] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.957097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.957214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.957651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.957779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.957910] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80b55fa4-94b0-4650-914a-ab8a9b2de890 already deleted. [ 837.958052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80b55fa4-94b0-4650-914a-ab8a9b2de890" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.573345] env[65087]: INFO networking_nsxv3.common.synchronization [req-fd1505ae-7f91-411b-ae03-0e71a34f3a2d req-83fc974f-3fc4-4a97-8bbc-3ec6effeb351 tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 838.577616] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 838.577616] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.577616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.577616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.577616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.577616] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.577616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.577616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.577616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.578037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.578037] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.938018] env[65087]: INFO networking_nsxv3.common.synchronization [None req-298e8bc3-45da-41e9-b544-fd5b6219b248 None None] Enqueued Resource ID: ee3a6ecf-34a9-4e16-84c8-c3817618be79 with Priority: HIGHEST for action port [ 838.938018] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee3a6ecf-34a9-4e16-84c8-c3817618be79 with Priority: HIGHEST for action port [ 838.938018] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee3a6ecf-34a9-4e16-84c8-c3817618be79 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.938018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee3a6ecf-34a9-4e16-84c8-c3817618be79" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.938018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee3a6ecf-34a9-4e16-84c8-c3817618be79" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.938018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee3a6ecf-34a9-4e16-84c8-c3817618be79" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.938018] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee3a6ecf-34a9-4e16-84c8-c3817618be79',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.995162] env[65087]: INFO networking_nsxv3.common.synchronization [req-d267775e-b0c6-4fdb-87d9-57dd7564adff req-22609685-1e9f-40d2-b0e9-b3bb29634bc5 tempest-ServerRescueNegativeTestJSON-853652026 tempest-ServerRescueNegativeTestJSON-853652026-project-member] Enqueued Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_members [ 838.995162] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_members [ 838.995803] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.996181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.996633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.997073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.997418] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.997748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.997915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.998366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.998638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.998847] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.081358] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.440477] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee3a6ecf-34a9-4e16-84c8-c3817618be79 [ 839.442029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.442029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.442029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.443282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.443392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.443762] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee3a6ecf-34a9-4e16-84c8-c3817618be79 already deleted. [ 839.443762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee3a6ecf-34a9-4e16-84c8-c3817618be79" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.507138] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.507138] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.507138] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d49db7-880a-475c-959f-8bf596c72350 already deleted. [ 839.507138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.521742] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-333 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.521742] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.521742] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.521742] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.521742] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.522034] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.522034] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.524105] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.524105] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.524105] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.524105] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.524105] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.524105] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.524105] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.524105] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.524105] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.548024] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.548024] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.548024] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.548024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-333" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.548024] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-96c12032-cded-44e1-8b5a-b9f07624f99a taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.548024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-96c12032-cded-44e1-8b5a-b9f07624f99a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.548024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-96c12032-cded-44e1-8b5a-b9f07624f99a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.548024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-96c12032-cded-44e1-8b5a-b9f07624f99a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.548640] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96c12032-cded-44e1-8b5a-b9f07624f99a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.585996] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.957612] env[65087]: INFO networking_nsxv3.common.synchronization [None req-da5c7848-2849-4b7e-b1ae-1473a14f4cad tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_rules [ 839.958792] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_rules [ 839.958792] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.958792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.958792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.959134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.959134] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.050883] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.051150] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.051283] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.051604] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.051779] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.051999] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 96c12032-cded-44e1-8b5a-b9f07624f99a not found, creating... [ 840.052382] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.052556] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.052695] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.052956] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.053131] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.053455] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.053632] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.053761] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.053991] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.054230] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.054391] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 96c12032-cded-44e1-8b5a-b9f07624f99a is going to be created. [ 840.093711] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.093961] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.094196] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.094488] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.094724] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.094947] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-96c12032-cded-44e1-8b5a-b9f07624f99a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.096147] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.096327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.096327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.096579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.096740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.096740] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 840.148793] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.148968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.149034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.149260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.149449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.159798] env[65087]: INFO networking_nsxv3.common.synchronization [None req-4227b9af-d0ae-43c6-b952-2f484c73a636 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_rules [ 840.160622] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_rules [ 840.160718] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.160814] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.162605] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 840.481625] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.481768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.481863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.482126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.482266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.482374] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 already deleted. [ 840.482465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.482616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.482794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.482891] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.615615] env[65087]: INFO networking_nsxv3.common.synchronization [None req-2a057352-6c2d-4f98-8cb9-5ac311ca849e None None] Enqueued Resource ID: 1fb79321-4fbc-404c-bec5-5b1a5ac9223a with Priority: HIGHEST for action port [ 840.615615] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fb79321-4fbc-404c-bec5-5b1a5ac9223a with Priority: HIGHEST for action port [ 840.616224] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fb79321-4fbc-404c-bec5-5b1a5ac9223a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.616604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fb79321-4fbc-404c-bec5-5b1a5ac9223a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.616809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fb79321-4fbc-404c-bec5-5b1a5ac9223a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.617187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fb79321-4fbc-404c-bec5-5b1a5ac9223a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.617462] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fb79321-4fbc-404c-bec5-5b1a5ac9223a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.815184] env[65087]: INFO networking_nsxv3.common.synchronization [req-d267775e-b0c6-4fdb-87d9-57dd7564adff req-9b859350-e18b-4918-8c6d-cab2f3d33cf5 service nova] Enqueued Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_rules [ 840.815531] env[65087]: INFO networking_nsxv3.common.synchronization [req-d267775e-b0c6-4fdb-87d9-57dd7564adff req-9b859350-e18b-4918-8c6d-cab2f3d33cf5 service nova] Enqueued Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_members [ 840.815693] env[65087]: INFO networking_nsxv3.common.synchronization [req-d267775e-b0c6-4fdb-87d9-57dd7564adff req-9b859350-e18b-4918-8c6d-cab2f3d33cf5 service nova] Enqueued Resource ID: 96c12032-cded-44e1-8b5a-b9f07624f99a with Priority: HIGHEST for action port [ 840.816551] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_rules [ 840.816744] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_members [ 840.816880] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c12032-cded-44e1-8b5a-b9f07624f99a with Priority: HIGHEST for action port [ 840.817430] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.817430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.817430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.817627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.818211] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.819028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.819028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.819169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.819462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.819462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.819614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.819924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.820099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.820186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.820279] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.821237] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-96c12032-cded-44e1-8b5a-b9f07624f99a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.821346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96c12032-cded-44e1-8b5a-b9f07624f99a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.821431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96c12032-cded-44e1-8b5a-b9f07624f99a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.821561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96c12032-cded-44e1-8b5a-b9f07624f99a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.821631] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96c12032-cded-44e1-8b5a-b9f07624f99a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.901740] env[65087]: INFO networking_nsxv3.common.synchronization [None req-cf6e4113-85a8-4e19-8401-98bcd50b43fe tempest-ServersTestManualDisk-848731207 tempest-ServersTestManualDisk-848731207-project-member] Enqueued Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_rules [ 840.901740] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_rules [ 840.901740] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dac161d-87bb-4f31-a632-3c3213ca7adf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.901740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.901740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.902650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.903256] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.992246] env[65087]: INFO networking_nsxv3.common.synchronization [None req-d0bb956d-6ff6-4ea0-afd5-7031e4d3fe04 tempest-ServersTestManualDisk-848731207 tempest-ServersTestManualDisk-848731207-project-member] Enqueued Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_rules [ 840.992621] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_rules [ 840.993059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dac161d-87bb-4f31-a632-3c3213ca7adf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.993174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.006645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.006645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.006645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.006645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.008111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.008279] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 already deleted. [ 841.008392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.120190] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fb79321-4fbc-404c-bec5-5b1a5ac9223a [ 841.120472] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.121082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.121082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.121082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.121082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.121082] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fb79321-4fbc-404c-bec5-5b1a5ac9223a already deleted. [ 841.121401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fb79321-4fbc-404c-bec5-5b1a5ac9223a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.324554] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.324554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.324693] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.325793] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96c12032-cded-44e1-8b5a-b9f07624f99a with status ACTIVE [ 841.326098] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.326307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.326437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.326828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.326990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.327269] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.327461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.327583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.327841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.327978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.328731] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.329029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.329029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.329287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.329494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.329667] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96c12032-cded-44e1-8b5a-b9f07624f99a is going to be updated. [ 841.356415] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.356415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.356415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.356415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.356415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.356415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96c12032-cded-44e1-8b5a-b9f07624f99a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.396736] env[65087]: INFO networking_nsxv3.common.synchronization [None req-f8ea5a2b-ded4-43e2-8df9-12dbbfdabbab None None] Enqueued Resource ID: ed47bb2e-dc9f-4048-b081-74d9179f3a51 with Priority: HIGHEST for action port [ 841.396736] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed47bb2e-dc9f-4048-b081-74d9179f3a51 with Priority: HIGHEST for action port [ 841.396736] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed47bb2e-dc9f-4048-b081-74d9179f3a51 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.396736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed47bb2e-dc9f-4048-b081-74d9179f3a51" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.396736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed47bb2e-dc9f-4048-b081-74d9179f3a51" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.396736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed47bb2e-dc9f-4048-b081-74d9179f3a51" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.397108] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed47bb2e-dc9f-4048-b081-74d9179f3a51',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.424791] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.424961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.425027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.425250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.425337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.425607] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf already deleted. [ 841.425607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.425775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.425826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.425927] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.832584] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.901257] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed47bb2e-dc9f-4048-b081-74d9179f3a51 [ 841.902589] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.902589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.902589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.902589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.902589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.902589] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed47bb2e-dc9f-4048-b081-74d9179f3a51 already deleted. [ 841.902589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed47bb2e-dc9f-4048-b081-74d9179f3a51" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.957665] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.957849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.958117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.958385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.958483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.958584] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf already deleted. [ 841.958668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.172864] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 842.173098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.335533] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.335706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.335752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.335966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.336159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.336159] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d49db7-880a-475c-959f-8bf596c72350 is going to be created. [ 842.363081] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.363081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.363081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.363344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.363344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.375262] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d49db7-880a-475c-959f-8bf596c72350 in Status: UNINITIALIZED for 2s [ 842.638190] env[65087]: INFO networking_nsxv3.common.synchronization [None req-31b2f54f-ad65-4bff-a203-c182822ce571 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_rules [ 842.638190] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_rules [ 842.638190] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d415299-ca3d-4305-942b-69b3b58ccb49 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.638190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.638190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.638190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.638190] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.748426] env[65087]: INFO networking_nsxv3.common.synchronization [None req-dee3f932-8aeb-4ebb-a6f8-94de869833b6 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_rules [ 842.754602] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_rules [ 842.755520] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d415299-ca3d-4305-942b-69b3b58ccb49 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.755520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.159351] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.160778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.160778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.160778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.160778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.160778] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 already deleted. [ 843.161155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.161155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.161280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.161380] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.673299] env[65087]: INFO networking_nsxv3.common.synchronization [req-105d392b-3750-44bd-aa0e-0e1a8f1b0fe9 req-37d244b7-d39d-4306-80df-0a2e40c276d7 tempest-InstanceActionsTestJSON-796026375 tempest-InstanceActionsTestJSON-796026375-project-member] Enqueued Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGHEST for action security_group_members [ 843.673761] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGHEST for action security_group_members [ 843.674929] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.674929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.674929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.674929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.675868] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.676040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.676155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.676369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.676508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.676647] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.685717] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.685853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.685936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.686250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.686250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.686511] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 already deleted. [ 843.686511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.083108] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-319 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.083601] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.083880] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.084336] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.085359] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.085766] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.086093] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.087075] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.087264] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.087632] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.087797] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.087942] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.088090] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.088256] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.088399] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.088749] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.110416] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.110416] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.110580] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.110826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-319" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.111042] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-824bb020-d60f-47a1-8437-c1e04c159b8b taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.112408] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-824bb020-d60f-47a1-8437-c1e04c159b8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.112408] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-824bb020-d60f-47a1-8437-c1e04c159b8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.112408] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-824bb020-d60f-47a1-8437-c1e04c159b8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.112408] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('824bb020-d60f-47a1-8437-c1e04c159b8b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.179571] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.179895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.179895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.180038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.180652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.180652] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.180652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.180652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.180652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.180652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.180919] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd already deleted. [ 844.180919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.390711] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d49db7-880a-475c-959f-8bf596c72350 in Status: SUCCESS [ 844.391398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.391398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.391531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.391937] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.391937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.392071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.392144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.392217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.392305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.392394] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.617041] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.617041] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.617041] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.617340] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.618035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.618564] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 824bb020-d60f-47a1-8437-c1e04c159b8b not found, creating... [ 844.618998] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.619200] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.619323] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.619567] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.619707] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.620017] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.620445] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.620550] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.620792] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.620909] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.621068] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 824bb020-d60f-47a1-8437-c1e04c159b8b is going to be created. [ 844.645387] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.646110] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.646408] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.647654] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.648510] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.648915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-824bb020-d60f-47a1-8437-c1e04c159b8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.898030] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.400224] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39d49db7-880a-475c-959f-8bf596c72350: rpc.has_security_group_logging(os_id): False [ 845.409610] env[65087]: INFO networking_nsxv3.common.synchronization [req-105d392b-3750-44bd-aa0e-0e1a8f1b0fe9 req-95de427a-35c5-4eb3-8680-97313802ef06 service nova] Enqueued Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGHEST for action security_group_rules [ 845.409846] env[65087]: INFO networking_nsxv3.common.synchronization [req-105d392b-3750-44bd-aa0e-0e1a8f1b0fe9 req-95de427a-35c5-4eb3-8680-97313802ef06 service nova] Enqueued Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGHEST for action security_group_members [ 845.410029] env[65087]: INFO networking_nsxv3.common.synchronization [req-105d392b-3750-44bd-aa0e-0e1a8f1b0fe9 req-95de427a-35c5-4eb3-8680-97313802ef06 service nova] Enqueued Resource ID: 824bb020-d60f-47a1-8437-c1e04c159b8b with Priority: HIGHEST for action port [ 845.410679] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGHEST for action security_group_rules [ 845.410829] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGHEST for action security_group_members [ 845.410930] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 824bb020-d60f-47a1-8437-c1e04c159b8b with Priority: HIGHEST for action port [ 845.411710] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.411710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.411710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.412012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.412012] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.412929] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.413070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.413159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.413355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.413537] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.413644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.413720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.413871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.413953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.416023] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.416023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-824bb020-d60f-47a1-8437-c1e04c159b8b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.416023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-824bb020-d60f-47a1-8437-c1e04c159b8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.416023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-824bb020-d60f-47a1-8437-c1e04c159b8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.416023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-824bb020-d60f-47a1-8437-c1e04c159b8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.416023] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('824bb020-d60f-47a1-8437-c1e04c159b8b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.420032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.420172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.420230] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.420381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.420479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.420721] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.421143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.421143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.421143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.421476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.421476] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d49db7-880a-475c-959f-8bf596c72350 is going to be created. [ 845.488346] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.488518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.488692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.488900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.489754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.502577] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d49db7-880a-475c-959f-8bf596c72350 in Status: IN_PROGRESS for 2s [ 845.917653] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.918964] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.919057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.919156] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 824bb020-d60f-47a1-8437-c1e04c159b8b with status ACTIVE [ 845.919382] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.919548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.919649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.919966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.920162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.920454] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.920999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.920999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.921137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.921214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.921720] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.921720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.921819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.922139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.922231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.922268] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 824bb020-d60f-47a1-8437-c1e04c159b8b is going to be updated. [ 845.943216] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.943411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.943478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.943665] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.943810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.944088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-824bb020-d60f-47a1-8437-c1e04c159b8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.080449] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7b05c50-10be-43d4-9931-4b8777de81b8 req-cbceeba4-e6d6-453d-99e3-93f1df661f6e tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 846.081343] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 846.083032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.083032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.083032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.083032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.083289] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.083289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.083289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.083416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.083480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.083572] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.185643] env[65087]: INFO networking_nsxv3.common.synchronization [req-a6ae1786-e42e-4dee-bd47-5dcb4bd664b6 req-457880fc-d425-4d2f-b27b-3c7093e7ffd3 tempest-VolumesAssistedSnapshotsTest-1625343650 tempest-VolumesAssistedSnapshotsTest-1625343650-project-member] Enqueued Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_members [ 846.186815] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd with Priority: HIGHEST for action security_group_members [ 846.187188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0521b23b-9dcc-40b0-a1c4-32590b372bcd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.187326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.187465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.187701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.187866] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.187993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.188088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.188268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.188349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.188445] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0521b23b-9dcc-40b0-a1c4-32590b372bcd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.424629] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.534115] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7b05c50-10be-43d4-9931-4b8777de81b8 req-531b4345-cab4-4338-a6b8-1e1a516fabba tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 846.535441] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 846.535537] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.536179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.586159] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.586419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.586884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.587044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.611084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.611256] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.612029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.612029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.612029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.612029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.612029] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 846.640868] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.642388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.642515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.642740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.643378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.653539] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 846.691557] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.691707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.691774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.693634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.713733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.714122] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.714379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.714476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.714762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.714889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.715052] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd is going to be updated. [ 846.746739] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.746739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.746860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.746984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.747149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.757745] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd in Status: IN_PROGRESS for 2s [ 846.903363] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.903558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-95" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.903686] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-95" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.904071] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-95" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.904358] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.904540] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.904628] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.904838] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.904970] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.908729] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.908854] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.909174] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.909301] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.910026] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.910026] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.910026] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.927833] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.927833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.927953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.928089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.928197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.928300] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd is going to be created. [ 846.931065] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.931233] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.931374] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.931541] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-95" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.931848] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-3df9f171-f1ce-40e5-a89e-8fefe63152d5 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.932082] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-3df9f171-f1ce-40e5-a89e-8fefe63152d5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.932221] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-3df9f171-f1ce-40e5-a89e-8fefe63152d5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.932550] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-3df9f171-f1ce-40e5-a89e-8fefe63152d5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.932899] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3df9f171-f1ce-40e5-a89e-8fefe63152d5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.962036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.962036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.962036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.962036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.962036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.971448] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd in Status: UNINITIALIZED for 2s [ 847.434959] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.435342] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.435401] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.435723] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.435890] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.436071] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 3df9f171-f1ce-40e5-a89e-8fefe63152d5 not found, creating... [ 847.436373] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.436842] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.436895] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.437116] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.437266] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.437567] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.441684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.441970] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.442430] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.442631] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.442855] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 3df9f171-f1ce-40e5-a89e-8fefe63152d5 is going to be created. [ 847.466852] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.467288] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.467329] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.467568] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.467812] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.468059] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-3df9f171-f1ce-40e5-a89e-8fefe63152d5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.517755] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d49db7-880a-475c-959f-8bf596c72350 in Status: SUCCESS [ 847.518009] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.207588] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7b05c50-10be-43d4-9931-4b8777de81b8 req-ce75307c-660a-4a58-bf88-e551adb9e667 service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 848.207588] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7b05c50-10be-43d4-9931-4b8777de81b8 req-ce75307c-660a-4a58-bf88-e551adb9e667 service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 848.207588] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7b05c50-10be-43d4-9931-4b8777de81b8 req-ce75307c-660a-4a58-bf88-e551adb9e667 service nova] Enqueued Resource ID: 3df9f171-f1ce-40e5-a89e-8fefe63152d5 with Priority: HIGHEST for action port [ 848.207897] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 848.210875] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 848.211079] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3df9f171-f1ce-40e5-a89e-8fefe63152d5 with Priority: HIGHEST for action port [ 848.211430] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.211551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.211636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.211847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.211925] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.213254] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.213981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.213981] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3df9f171-f1ce-40e5-a89e-8fefe63152d5 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.213981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3df9f171-f1ce-40e5-a89e-8fefe63152d5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.213981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3df9f171-f1ce-40e5-a89e-8fefe63152d5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.214352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3df9f171-f1ce-40e5-a89e-8fefe63152d5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.214352] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3df9f171-f1ce-40e5-a89e-8fefe63152d5',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.664266] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 848.664749] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f deletion is rescheduled due to dependency. [ 848.664749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.664749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.664970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.665124] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.665357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.665357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.665594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.665648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.666265] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.718184] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.718184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.718414] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3df9f171-f1ce-40e5-a89e-8fefe63152d5 with status ACTIVE [ 848.718528] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.718632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.718680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.718928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.720065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.720329] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.720420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.720494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.720742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.720796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.721064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.721221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.721586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.721586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.721586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.721812] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3df9f171-f1ce-40e5-a89e-8fefe63152d5 is going to be updated. [ 848.758368] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.758667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.758667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.758933] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.758933] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.759383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3df9f171-f1ce-40e5-a89e-8fefe63152d5" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.774334] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd in Status: SUCCESS [ 848.774653] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0521b23b-9dcc-40b0-a1c4-32590b372bcd deletion is rescheduled due to dependency. [ 848.774777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0521b23b-9dcc-40b0-a1c4-32590b372bcd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.983855] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd in Status: SUCCESS [ 848.983855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.983855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.984506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.984506] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.985440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.985440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.985440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.985440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.985440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.985440] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.031377] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-604 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.032124] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-604" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.032245] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-604" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.032521] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-604" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.032902] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.033158] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.033433] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.033757] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.033970] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.034379] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.034546] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.034702] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.034822] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.034940] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.035064] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.035212] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.056491] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.056664] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.056798] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.057059] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-604" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.057505] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-1b34411d-a849-4399-88fa-4ec663b8b22d taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.057827] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-1b34411d-a849-4399-88fa-4ec663b8b22d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.058010] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-1b34411d-a849-4399-88fa-4ec663b8b22d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.058414] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-1b34411d-a849-4399-88fa-4ec663b8b22d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.058580] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b34411d-a849-4399-88fa-4ec663b8b22d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.168152] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.489997] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.489997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.489997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.489997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.489997] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.489997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.489997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.489997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.489997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.490547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.490547] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.490547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.490547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.490547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.490711] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.490711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.490711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.490851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.491076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.491076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.491076] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.562250] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.562250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.562250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.562250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.562250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.562250] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 1b34411d-a849-4399-88fa-4ec663b8b22d not found, creating... [ 849.562250] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.562567] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.562567] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.562638] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.562756] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.563040] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.563196] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.563309] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.567521] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.567521] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.567521] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 1b34411d-a849-4399-88fa-4ec663b8b22d is going to be created. [ 849.591527] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.591527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.591527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.591527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.591527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.591527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-1b34411d-a849-4399-88fa-4ec663b8b22d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.671629] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.772821] env[65087]: INFO networking_nsxv3.common.synchronization [req-e2f1ec1a-e388-4996-a3c1-1bb39ab3bbf7 req-66f0a76c-dc65-472b-9176-2fd666fee2dc tempest-ServerActionsV293TestJSON-527788909 tempest-ServerActionsV293TestJSON-527788909-project-member] Enqueued Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_members [ 849.773532] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_members [ 849.773871] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c5346a-4114-4ee9-bda4-7f968a612f58 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.773990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.774068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.774376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.774524] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.774634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.774677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.774833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.774917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.775015] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.993978] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd: rpc.has_security_group_logging(os_id): False [ 850.014461] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.014461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.014461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.014793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.014793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.014927] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.015046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.015123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.015489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.015489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.015489] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.015881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.015881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.015881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.015881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.019192] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.019192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.019192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.019192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.019192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.019192] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd is going to be created. [ 850.132816] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.132816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.132816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.132816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.132816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.149074] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-680 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.149568] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-680" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.149998] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-680" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.150644] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-680" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.152129] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.152601] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.152957] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.153655] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.153898] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.154293] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.154406] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.154515] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.154678] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.154804] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.154917] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.155097] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.157283] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd in Status: IN_PROGRESS for 2s [ 850.174580] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.174815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.174900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.175282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.175472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.175661] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 850.197960] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.198198] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.198396] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.198615] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-680" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.199128] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-c297756c-35ce-4b8a-94e0-ba2c53672d12 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.199341] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-c297756c-35ce-4b8a-94e0-ba2c53672d12" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.199472] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-c297756c-35ce-4b8a-94e0-ba2c53672d12" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.199818] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-c297756c-35ce-4b8a-94e0-ba2c53672d12" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.199950] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c297756c-35ce-4b8a-94e0-ba2c53672d12',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.222995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.222995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.223313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.223357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.223598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.241068] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 850.280837] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.281026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.281084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.281350] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.281769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.281769] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.281769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.281922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.282182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.282182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.282182] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 already deleted. [ 850.283205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.368976] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7b05c50-10be-43d4-9931-4b8777de81b8 req-d1cdd462-098f-4dc0-9063-e95933da94f6 service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 850.369340] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7b05c50-10be-43d4-9931-4b8777de81b8 req-d1cdd462-098f-4dc0-9063-e95933da94f6 service nova] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 850.369603] env[65087]: INFO networking_nsxv3.common.synchronization [req-a7b05c50-10be-43d4-9931-4b8777de81b8 req-d1cdd462-098f-4dc0-9063-e95933da94f6 service nova] Enqueued Resource ID: 1b34411d-a849-4399-88fa-4ec663b8b22d with Priority: HIGHEST for action port [ 850.370446] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_rules [ 850.370650] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 850.370800] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b34411d-a849-4399-88fa-4ec663b8b22d with Priority: HIGHEST for action port [ 850.371215] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.371371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.371669] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.371799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.372080] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b34411d-a849-4399-88fa-4ec663b8b22d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.372236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b34411d-a849-4399-88fa-4ec663b8b22d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.372335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b34411d-a849-4399-88fa-4ec663b8b22d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.373078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b34411d-a849-4399-88fa-4ec663b8b22d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.373213] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b34411d-a849-4399-88fa-4ec663b8b22d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.702904] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.703324] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.703372] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.703633] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.703781] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.703933] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port c297756c-35ce-4b8a-94e0-ba2c53672d12 not found, creating... [ 850.704211] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.704428] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.704544] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.704751] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.704885] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.705171] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.705330] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.705463] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.705666] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.705794] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.705930] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: c297756c-35ce-4b8a-94e0-ba2c53672d12 is going to be created. [ 850.726253] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.726448] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.726639] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.726823] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.727064] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.727287] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-c297756c-35ce-4b8a-94e0-ba2c53672d12" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.876296] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b34411d-a849-4399-88fa-4ec663b8b22d with status ACTIVE [ 850.876543] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.876788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.876851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.877059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.877158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.877854] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.877854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.877854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.877854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.877854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.878109] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.878181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.878286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.878476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.878598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.878692] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b34411d-a849-4399-88fa-4ec663b8b22d is going to be updated. [ 850.912303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.912502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.912551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.913598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.913598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.913598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b34411d-a849-4399-88fa-4ec663b8b22d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.478914] env[65087]: INFO networking_nsxv3.common.synchronization [req-e2f1ec1a-e388-4996-a3c1-1bb39ab3bbf7 req-102a05c9-e68c-424c-9414-9361752cf883 service nova] Enqueued Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_rules [ 851.479144] env[65087]: INFO networking_nsxv3.common.synchronization [req-e2f1ec1a-e388-4996-a3c1-1bb39ab3bbf7 req-102a05c9-e68c-424c-9414-9361752cf883 service nova] Enqueued Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_members [ 851.479355] env[65087]: INFO networking_nsxv3.common.synchronization [req-e2f1ec1a-e388-4996-a3c1-1bb39ab3bbf7 req-102a05c9-e68c-424c-9414-9361752cf883 service nova] Enqueued Resource ID: c297756c-35ce-4b8a-94e0-ba2c53672d12 with Priority: HIGHEST for action port [ 851.479935] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_rules [ 851.480290] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_members [ 851.480389] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c297756c-35ce-4b8a-94e0-ba2c53672d12 with Priority: HIGHEST for action port [ 851.480685] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13c5346a-4114-4ee9-bda4-7f968a612f58 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.480783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.480858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.481107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.481379] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.483903] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c5346a-4114-4ee9-bda4-7f968a612f58 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.484089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.484347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.484488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.484808] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.484808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.484808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.484944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.485059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.485105] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.485953] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-c297756c-35ce-4b8a-94e0-ba2c53672d12 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.486091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c297756c-35ce-4b8a-94e0-ba2c53672d12" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.486322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c297756c-35ce-4b8a-94e0-ba2c53672d12" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.486322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c297756c-35ce-4b8a-94e0-ba2c53672d12" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.486419] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c297756c-35ce-4b8a-94e0-ba2c53672d12',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.990774] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c5346a-4114-4ee9-bda4-7f968a612f58 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.991080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.991123] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.992542] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c297756c-35ce-4b8a-94e0-ba2c53672d12 with status ACTIVE [ 851.992542] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.992723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.992723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.995595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.995595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.995595] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.996303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.996303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.996303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.996303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.996303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.996303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.996550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.996550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.996550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.996669] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c297756c-35ce-4b8a-94e0-ba2c53672d12 is going to be updated. [ 852.025683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.026144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.026286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.026627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.026881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.027164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c297756c-35ce-4b8a-94e0-ba2c53672d12" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.172854] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd in Status: SUCCESS [ 852.172854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.254880] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 852.255067] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.255249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.255520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.255719] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.255857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.255944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.256383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.256383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.256383] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.500507] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.759413] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.003721] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.003721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.004063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.004063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.004144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.004286] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 is going to be created. [ 853.033267] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.033423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.033502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.033728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.034422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.046865] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 in Status: UNINITIALIZED for 2s [ 853.263470] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.768955] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.769318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.769318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.769436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.769475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.769593] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 853.805273] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.805471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.805568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.805881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.806112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.817448] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 855.057917] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 in Status: SUCCESS [ 855.058317] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.058317] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.058639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.058879] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.059082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.059158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.059311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.059418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.059528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.059645] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.562523] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.833829] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 855.833829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.833829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.833829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.833829] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.834080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.834080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.834443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.834544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.834858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.834858] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.836030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.836218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.836447] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.837043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.837043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.837043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.837043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.837302] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.065454] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13c5346a-4114-4ee9-bda4-7f968a612f58: rpc.has_security_group_logging(os_id): False [ 856.085844] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.086020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.086092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.086293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.086386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.086798] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.086798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.086943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.087261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.087261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.087449] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 is going to be created. [ 856.157458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.157458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.157458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.157771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.158339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.173038] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 in Status: IN_PROGRESS for 2s [ 856.340577] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.340757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.341020] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.481790] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 856.481925] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 856.843966] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.349623] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.350028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.350028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.351731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.351731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.351731] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 857.381116] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.381260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.381332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.381539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.381685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.394050] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 858.189384] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 in Status: SUCCESS [ 858.189686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.411699] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.411699] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.411699] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.411699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.413095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.413432] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.413678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.414011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.414308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.414675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.414977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.415221] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.919938] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e56f2582-99a0-4048-840f-b0950b64562f: rpc.has_security_group_logging(os_id): False [ 859.943860] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.944113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.944213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.944597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.944732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.946632] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.946829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.946936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.947220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.947356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.947758] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.947940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.948018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.948239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.948391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.948695] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.948856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.949311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.949311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.949311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.949680] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 860.031709] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.032174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.032174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.032437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.032632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.058830] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 860.327562] env[65087]: INFO networking_nsxv3.common.synchronization [req-e94ec620-54ae-407e-9da2-d6100ed65319 req-811c8a20-190d-4f48-a455-6e4f8a37e5ee tempest-ServersAdminTestJSON-1882897549 tempest-ServersAdminTestJSON-1882897549-project-member] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 860.328263] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 860.328676] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.328853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.328943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.329317] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.329399] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.329589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.329589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.329743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.330583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.330583] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.831998] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.336934] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.839404] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.839764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.839764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.840142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.840359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.840513] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 861.871441] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.871686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.871773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.871995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.872165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.882197] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 862.076590] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 862.077027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.077027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.077299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.077491] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.287223] env[65087]: INFO networking_nsxv3.common.synchronization [req-a6db6cbc-682e-4f44-9d55-bc65b3a7a826 req-be428258-5305-4d19-9fdd-53f022a51de7 tempest-InstanceActionsTestJSON-796026375 tempest-InstanceActionsTestJSON-796026375-project-member] Enqueued Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGHEST for action security_group_members [ 862.288063] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGHEST for action security_group_members [ 862.288485] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.288645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.288810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.288978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.289418] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.289418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.289418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.289643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.289643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.289719] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.580573] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.580732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.580804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.581068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.581198] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.581544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.581620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.581856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.581918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.581993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.582095] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.793140] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.793387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.793536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.793816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.793916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.794167] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.794399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.794511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.794780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.794932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.795096] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd is going to be updated. [ 862.825653] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.825894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.825894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.826104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.826266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.835281] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd in Status: IN_PROGRESS for 2s [ 863.047973] env[65087]: INFO networking_nsxv3.common.synchronization [req-b14aef7b-77db-4eca-ade0-a9da2872236b req-9f94ece8-23fe-4c49-a1bc-94dce3b1efdb tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 863.047973] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 863.051312] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.051450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.051521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.051743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.051906] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.052057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.052096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.052214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.052333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.052440] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.085597] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.085878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.345830] env[65087]: INFO networking_nsxv3.common.synchronization [req-b14aef7b-77db-4eca-ade0-a9da2872236b req-0865a68a-3cd5-40e8-9cc1-71b212031632 tempest-ServersTestMultiNic-1859042674 tempest-ServersTestMultiNic-1859042674-project-member] Enqueued Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 863.346228] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56f2582-99a0-4048-840f-b0950b64562f with Priority: HIGHEST for action security_group_members [ 863.346552] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.347076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.555064] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.894618] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 863.894618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.059429] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.562889] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.562889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.562889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.563168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.563168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.563168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 864.602847] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.602991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.603084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.603295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.603444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.612933] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 864.846408] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd in Status: SUCCESS [ 864.846720] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd deletion is rescheduled due to dependency. [ 864.846909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.842021] env[65087]: INFO networking_nsxv3.common.synchronization [req-28169963-9ec3-4231-a95b-86e0aea2f3c6 req-1b3fc59d-2f89-4e38-9d49-943901ffd089 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 865.842279] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 865.842610] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.843467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.843467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.843467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.843467] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.843467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.843467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.843722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.843722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.843770] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.212300] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.212546] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.216020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.216020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.216020] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.216020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.216020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.216020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.216020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.216020] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.216020] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.216020] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.216020] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.216020] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 866.216020] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.216020] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.239856] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.240134] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.240630] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.241231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.242135] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-132c2725-bcff-46a4-8d34-9c724d31d90f taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.242953] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-132c2725-bcff-46a4-8d34-9c724d31d90f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.243190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-132c2725-bcff-46a4-8d34-9c724d31d90f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.243995] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-132c2725-bcff-46a4-8d34-9c724d31d90f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.244476] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132c2725-bcff-46a4-8d34-9c724d31d90f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.347040] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.347040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.347040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.347040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.347285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.347285] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.347468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.347468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.347629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.347675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.347741] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 already deleted. [ 866.347818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.625314] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 866.625657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.625791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.626060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.626267] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.626388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.626456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.626623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.626709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.626793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.626985] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56f2582-99a0-4048-840f-b0950b64562f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.627109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.627182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.627385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.627565] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.627667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.627730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.627903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.627937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.628036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.628126] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.629050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.629227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.629377] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.629480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.629543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.629699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.629782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.629873] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56f2582-99a0-4048-840f-b0950b64562f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.749806] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.750527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.750527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.750712] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.750920] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.751091] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 132c2725-bcff-46a4-8d34-9c724d31d90f not found, creating... [ 866.751382] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.751657] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.752025] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.752123] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.752198] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.752589] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.752870] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.752990] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.753223] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.753357] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.753497] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 132c2725-bcff-46a4-8d34-9c724d31d90f is going to be created. [ 866.780465] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.780615] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.780728] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.781028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.781262] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.781493] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-132c2725-bcff-46a4-8d34-9c724d31d90f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.131552] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e56f2582-99a0-4048-840f-b0950b64562f: rpc.has_security_group_logging(os_id): False [ 867.132814] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.133022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.133022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.133235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.133329] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.133513] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.133627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.133673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.133821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.133898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.133984] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 867.149805] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.149999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.150073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.150260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.150350] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.150567] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.150667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.150727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.150880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.150957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.151154] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.151250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.151312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.151471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.151548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.151723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.151818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.151879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.152028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.152105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.152191] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56f2582-99a0-4048-840f-b0950b64562f is going to be updated. [ 867.161223] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.161392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.161816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.161816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.161944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.174286] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 867.226029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.226180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.226375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.226474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.226624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.243071] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: IN_PROGRESS for 2s [ 867.532441] env[65087]: INFO networking_nsxv3.common.synchronization [req-28169963-9ec3-4231-a95b-86e0aea2f3c6 req-52821a98-e1f2-4d4f-b79f-40cfe34f3e90 service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 867.532441] env[65087]: INFO networking_nsxv3.common.synchronization [req-28169963-9ec3-4231-a95b-86e0aea2f3c6 req-52821a98-e1f2-4d4f-b79f-40cfe34f3e90 service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 867.532764] env[65087]: INFO networking_nsxv3.common.synchronization [req-28169963-9ec3-4231-a95b-86e0aea2f3c6 req-52821a98-e1f2-4d4f-b79f-40cfe34f3e90 service nova] Enqueued Resource ID: 132c2725-bcff-46a4-8d34-9c724d31d90f with Priority: HIGHEST for action port [ 867.534843] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 867.534976] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 867.535141] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 132c2725-bcff-46a4-8d34-9c724d31d90f with Priority: HIGHEST for action port [ 867.535389] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.535531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.535620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.535873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.535989] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.536878] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.536998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.537091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.537408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.537408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.537585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.537621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.537764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.537844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.537937] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.538729] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-132c2725-bcff-46a4-8d34-9c724d31d90f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.538848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-132c2725-bcff-46a4-8d34-9c724d31d90f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.538896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-132c2725-bcff-46a4-8d34-9c724d31d90f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.539064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-132c2725-bcff-46a4-8d34-9c724d31d90f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.539145] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132c2725-bcff-46a4-8d34-9c724d31d90f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.042566] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.043306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.043306] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.044743] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 132c2725-bcff-46a4-8d34-9c724d31d90f with status ACTIVE [ 868.045898] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.047028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.047028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.047028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.047028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.047028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.047028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.047270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.047324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.047409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.047645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.047976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.047976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.048042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.048133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.048224] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 132c2725-bcff-46a4-8d34-9c724d31d90f is going to be updated. [ 868.073394] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.074095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.074216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.075039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.075039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.075039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-132c2725-bcff-46a4-8d34-9c724d31d90f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.550969] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.808163] env[65087]: INFO networking_nsxv3.common.synchronization [req-340b2995-368b-4855-a3c7-d41d8c789a62 req-acbe56e0-c9c8-4706-bbf0-f7d9188b9548 tempest-MigrationsAdminTest-836415837 tempest-MigrationsAdminTest-836415837-project-member] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 868.809311] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 868.812707] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.812707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.812707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.812707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.812707] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.812707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.812707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.812707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.812707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.812707] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.054309] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.054540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.054599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.054823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.054932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.055058] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be created. [ 869.080605] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.080801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.080897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.081182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.081394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.092486] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: UNINITIALIZED for 2s [ 869.184882] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 869.185110] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56f2582-99a0-4048-840f-b0950b64562f deletion is rescheduled due to dependency. [ 869.185265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.257797] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56f2582-99a0-4048-840f-b0950b64562f in Status: SUCCESS [ 869.258053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56f2582-99a0-4048-840f-b0950b64562f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.315941] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.818187] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.323242] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.323711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.323711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.323711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.323825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.323850] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be updated. [ 870.353340] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.353540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.353540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.353810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.353886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.365455] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: IN_PROGRESS for 2s [ 871.101943] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 871.102347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.102347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.102586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.102789] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.102933] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.103011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.103210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.103298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.103410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.103515] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.606616] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.606858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.606858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.607636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.607636] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.607636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.607636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.607636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.607636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.607636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.607871] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.607952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.608046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.608171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.608313] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.608458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.608458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.608578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.608671] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.608725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.608816] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.048586] env[65087]: INFO networking_nsxv3.common.synchronization [req-fe721234-8364-47b2-9c37-3e6cdd326ca3 req-705f5a34-9b63-4e76-94b6-e371fcc8b028 tempest-ListImageFiltersTestJSON-1884000138 tempest-ListImageFiltersTestJSON-1884000138-project-member] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 872.049689] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 872.050147] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.050256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.050256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.050495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.050673] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.050776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.050838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.051017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.051129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.051228] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.110761] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e5af08c-4029-463c-937e-2ea7bf68d7d1: rpc.has_security_group_logging(os_id): False [ 872.131683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.132046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.132131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.132389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.132605] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.132863] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.132973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.133062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.133260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.133386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.137036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.137036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.137036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.137036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.137036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.137036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.137036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.137036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.137036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.137036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.137036] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be created. [ 872.211287] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.211513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.211681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.212095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.212619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.226530] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 872.377109] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: SUCCESS [ 872.377379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.555531] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.059052] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.560733] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.561151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.561151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.561240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.561308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.561384] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb is going to be updated. [ 873.594028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.594241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.594241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.594402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.594651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.603411] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: IN_PROGRESS for 2s [ 873.989016] env[65087]: INFO networking_nsxv3.common.synchronization [req-55a3f8bf-259c-4ac5-98d3-6da89971b8d8 req-c44a5080-ba1f-40a8-a5a5-a5b6716c68d5 tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 873.989570] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 873.989868] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.989996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.990079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.990285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.990447] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.990547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.990610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.990758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.990845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.990938] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.243347] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 874.243610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.493616] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.493856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.493923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.495034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.495034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.495034] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.495034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.495034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.495435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.495435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.495435] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 874.531519] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.531819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.531819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.531984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.532158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.542625] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 875.619834] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: SUCCESS [ 875.620108] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.230969] env[65087]: INFO networking_nsxv3.common.synchronization [req-62be4d27-87c7-4e6a-a1ac-13ab07e24941 req-24849124-d55b-4ac2-91b2-a1a2b2cdd625 tempest-ServerRescueTestJSON-1537167573 tempest-ServerRescueTestJSON-1537167573-project-member] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 876.231559] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 876.231910] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.232123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.232123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.232336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.232501] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.232611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.232659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.232831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.232916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.233023] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.556970] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 876.557293] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 deletion is rescheduled due to dependency. [ 876.557293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.588863] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-52 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.589118] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-52" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.590906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-52" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.590906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-52" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.590906] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.590906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.590906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.590906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.590906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.590906] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.590906] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.590906] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.590906] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.590906] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.591295] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.591295] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.611498] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.611686] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.611848] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.612113] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-52" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.612443] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-7034a1a1-311d-4f24-831a-c07ec0c2d395 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.612635] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-7034a1a1-311d-4f24-831a-c07ec0c2d395" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.612783] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-7034a1a1-311d-4f24-831a-c07ec0c2d395" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.613234] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-7034a1a1-311d-4f24-831a-c07ec0c2d395" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.613440] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7034a1a1-311d-4f24-831a-c07ec0c2d395',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.735696] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.117211] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.117610] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.117704] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.118048] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.118147] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.118322] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 7034a1a1-311d-4f24-831a-c07ec0c2d395 not found, creating... [ 877.118585] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.118722] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.118837] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.119279] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.119421] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.119705] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.119852] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.119980] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.120431] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.120563] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.120701] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 7034a1a1-311d-4f24-831a-c07ec0c2d395 is going to be created. [ 877.147027] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.147233] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.147356] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.147629] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.147856] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.148095] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-7034a1a1-311d-4f24-831a-c07ec0c2d395" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.238481] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.741868] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.741868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.741868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.742242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.742242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.742242] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be is going to be updated. [ 877.774505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.774680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.774753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.774968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.775693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.785699] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: IN_PROGRESS for 2s [ 877.849021] env[65087]: INFO networking_nsxv3.common.synchronization [req-62be4d27-87c7-4e6a-a1ac-13ab07e24941 req-3075f184-cad0-47fd-a62a-3ba3c6e35f12 service nova] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_rules [ 877.849021] env[65087]: INFO networking_nsxv3.common.synchronization [req-62be4d27-87c7-4e6a-a1ac-13ab07e24941 req-3075f184-cad0-47fd-a62a-3ba3c6e35f12 service nova] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 877.849021] env[65087]: INFO networking_nsxv3.common.synchronization [req-62be4d27-87c7-4e6a-a1ac-13ab07e24941 req-3075f184-cad0-47fd-a62a-3ba3c6e35f12 service nova] Enqueued Resource ID: 7034a1a1-311d-4f24-831a-c07ec0c2d395 with Priority: HIGHEST for action port [ 877.849021] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_rules [ 877.849021] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 877.849021] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7034a1a1-311d-4f24-831a-c07ec0c2d395 with Priority: HIGHEST for action port [ 877.849021] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.849021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.849021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.849021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.849021] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.850828] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.851072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.851438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7034a1a1-311d-4f24-831a-c07ec0c2d395 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.851727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7034a1a1-311d-4f24-831a-c07ec0c2d395" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.852980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7034a1a1-311d-4f24-831a-c07ec0c2d395" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.852980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7034a1a1-311d-4f24-831a-c07ec0c2d395" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.852980] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7034a1a1-311d-4f24-831a-c07ec0c2d395',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.355277] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.355437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.355730] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7034a1a1-311d-4f24-831a-c07ec0c2d395 with status ACTIVE [ 878.355975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.356044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.356089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.356311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.356408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.356586] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.356680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.356753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.356941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.357043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.357231] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.357404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.357404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.357547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.357593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.357683] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7034a1a1-311d-4f24-831a-c07ec0c2d395 is going to be updated. [ 878.381354] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.381354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.381354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.381354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.381354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.381671] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7034a1a1-311d-4f24-831a-c07ec0c2d395" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.953202] env[65087]: INFO networking_nsxv3.common.synchronization [req-81b75e64-056e-4631-a95c-0b18fa400bce req-4c3b01ad-112f-44eb-b8d2-9d4e46754b5f tempest-ServerMetadataTestJSON-465670558 tempest-ServerMetadataTestJSON-465670558-project-member] Enqueued Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGHEST for action security_group_members [ 878.953715] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGHEST for action security_group_members [ 878.954024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd4d842-afe8-4003-a8ee-07600ff1edfd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.954305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.954418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.954738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.954908] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.955032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.955110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.955274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.955363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.955463] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.382129] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-265 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.382129] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-265" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.382129] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-265" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.382436] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-265" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.382822] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.383136] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.383345] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.383728] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.384047] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.384385] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.384637] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.384905] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.385376] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.385652] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.385863] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.386093] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.409023] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.409023] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.409023] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.409023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-265" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.409023] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-c56d256b-fa0f-4c21-be59-ff4c49168569 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.409023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-c56d256b-fa0f-4c21-be59-ff4c49168569" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.409023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-c56d256b-fa0f-4c21-be59-ff4c49168569" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.409023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-c56d256b-fa0f-4c21-be59-ff4c49168569" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.409023] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c56d256b-fa0f-4c21-be59-ff4c49168569',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.458725] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.459629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.459629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.459629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.459629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.459629] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.459629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.459629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.459921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.459921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.459921] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd already deleted. [ 879.460096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.797831] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: SUCCESS [ 879.798115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.798459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.798910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.798995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.799190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.799355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.799549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.799660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.799819] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.911880] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.911880] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.912052] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.912268] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.912423] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.912580] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port c56d256b-fa0f-4c21-be59-ff4c49168569 not found, creating... [ 879.912920] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.913102] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.913217] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.913661] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.913661] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.914536] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.916098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.916098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.916098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.916098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.916098] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: c56d256b-fa0f-4c21-be59-ff4c49168569 is going to be created. [ 879.937145] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.937368] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.937478] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.937729] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.938030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.938280] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-c56d256b-fa0f-4c21-be59-ff4c49168569" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.302284] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.695158] env[65087]: INFO networking_nsxv3.common.synchronization [req-81b75e64-056e-4631-a95c-0b18fa400bce req-4edce1dd-f063-45a0-863e-0149dfeb362b service nova] Enqueued Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGHEST for action security_group_rules [ 880.695158] env[65087]: INFO networking_nsxv3.common.synchronization [req-81b75e64-056e-4631-a95c-0b18fa400bce req-4edce1dd-f063-45a0-863e-0149dfeb362b service nova] Enqueued Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGHEST for action security_group_members [ 880.695158] env[65087]: INFO networking_nsxv3.common.synchronization [req-81b75e64-056e-4631-a95c-0b18fa400bce req-4edce1dd-f063-45a0-863e-0149dfeb362b service nova] Enqueued Resource ID: c56d256b-fa0f-4c21-be59-ff4c49168569 with Priority: HIGHEST for action port [ 880.695548] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGHEST for action security_group_rules [ 880.695707] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGHEST for action security_group_members [ 880.695839] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c56d256b-fa0f-4c21-be59-ff4c49168569 with Priority: HIGHEST for action port [ 880.696198] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.696326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.696427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.696657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.696745] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.697581] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd4d842-afe8-4003-a8ee-07600ff1edfd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.698506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.698506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.698506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.698506] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.698506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.698506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.698506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.698506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.698506] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.699652] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-c56d256b-fa0f-4c21-be59-ff4c49168569 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.699968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c56d256b-fa0f-4c21-be59-ff4c49168569" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.699968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c56d256b-fa0f-4c21-be59-ff4c49168569" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.700046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c56d256b-fa0f-4c21-be59-ff4c49168569" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.700077] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c56d256b-fa0f-4c21-be59-ff4c49168569',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.804787] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.202171] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.203416] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd4d842-afe8-4003-a8ee-07600ff1edfd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.203416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.203570] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c56d256b-fa0f-4c21-be59-ff4c49168569 with status ACTIVE [ 881.203726] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.203907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.203907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.205053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.205053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.205053] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.205053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.205053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.205053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.205053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.205053] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.205358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.205358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.205584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.205584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.205584] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c56d256b-fa0f-4c21-be59-ff4c49168569 is going to be updated. [ 881.230684] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.230882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.230920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.231235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.231316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.231825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c56d256b-fa0f-4c21-be59-ff4c49168569" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.307684] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.308047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.308047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.308126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.308238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.308339] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be is going to be updated. [ 881.347846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.348082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.348082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.348292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.348453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.361894] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: IN_PROGRESS for 2s [ 881.670629] env[65087]: INFO networking_nsxv3.common.synchronization [req-ab3b4326-6437-4ec2-80dc-d7db88fe476d req-7a021613-4fb8-4786-a3af-fdc8771a63ba tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_members [ 881.670629] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_members [ 881.671633] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.671633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.671633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.671633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.671633] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.671996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.671996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.674040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.674040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.674040] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.708117] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.108873] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.108873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.108873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.108873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.108873] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.108873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.108873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.108873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.108873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.108873] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.108873] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.108873] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.108873] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.109468] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.109468] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.109468] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.132180] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.132353] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.132516] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.132657] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.133024] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-0689c8e1-5a9e-42bc-905e-8bedad0801e4 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.133272] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-0689c8e1-5a9e-42bc-905e-8bedad0801e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.134291] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-0689c8e1-5a9e-42bc-905e-8bedad0801e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.134291] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-0689c8e1-5a9e-42bc-905e-8bedad0801e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.134291] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0689c8e1-5a9e-42bc-905e-8bedad0801e4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.177415] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.177599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.177722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.178014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.178143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.178362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.178469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.178597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.178776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.178880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.178991] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 already deleted. [ 882.179097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.211893] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.211975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.212063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.212291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.212722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.212854] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd is going to be created. [ 882.246058] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.246259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.246498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.246705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.247279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.259192] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd in Status: UNINITIALIZED for 2s [ 882.642181] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.642181] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.642181] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.642181] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.642181] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.642181] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 0689c8e1-5a9e-42bc-905e-8bedad0801e4 not found, creating... [ 882.646686] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.646686] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.646686] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.646686] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.646686] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.647173] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.647173] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.647173] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.647283] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.650259] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.650259] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 0689c8e1-5a9e-42bc-905e-8bedad0801e4 is going to be created. [ 882.669715] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.669715] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.669715] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.669715] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.669715] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.669715] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-0689c8e1-5a9e-42bc-905e-8bedad0801e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.375665] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: SUCCESS [ 883.376131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.376506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.377289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.377289] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.377628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.377827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.378226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.378883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.378883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.378883] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.397527] env[65087]: INFO networking_nsxv3.common.synchronization [req-ab3b4326-6437-4ec2-80dc-d7db88fe476d req-f1fbc6c7-a625-47f0-a5ad-50f62142279c service nova] Enqueued Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_rules [ 883.397717] env[65087]: INFO networking_nsxv3.common.synchronization [req-ab3b4326-6437-4ec2-80dc-d7db88fe476d req-f1fbc6c7-a625-47f0-a5ad-50f62142279c service nova] Enqueued Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_members [ 883.397956] env[65087]: INFO networking_nsxv3.common.synchronization [req-ab3b4326-6437-4ec2-80dc-d7db88fe476d req-f1fbc6c7-a625-47f0-a5ad-50f62142279c service nova] Enqueued Resource ID: 0689c8e1-5a9e-42bc-905e-8bedad0801e4 with Priority: HIGHEST for action port [ 883.400641] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_rules [ 883.400905] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_members [ 883.401740] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0689c8e1-5a9e-42bc-905e-8bedad0801e4 with Priority: HIGHEST for action port [ 883.401862] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.402664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.402664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.403245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.403458] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.408146] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.408294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.408397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.408557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.408734] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.408840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.408904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.409077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.409166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.409264] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.414400] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0689c8e1-5a9e-42bc-905e-8bedad0801e4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.414400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0689c8e1-5a9e-42bc-905e-8bedad0801e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.414400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0689c8e1-5a9e-42bc-905e-8bedad0801e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.414400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0689c8e1-5a9e-42bc-905e-8bedad0801e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.414751] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0689c8e1-5a9e-42bc-905e-8bedad0801e4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.881381] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.881700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.882030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.882459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.882749] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.882924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.883100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.883450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.883602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.883764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.884505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.887270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.887378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.887616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.887803] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.887916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.887981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.888347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.888438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.888529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.888665] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.908478] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.909389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.918401] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.918841] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0689c8e1-5a9e-42bc-905e-8bedad0801e4 with status ACTIVE [ 883.919175] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.919332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.919427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.919733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.919840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.920067] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.920178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.920269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.920509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.920631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.921470] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.921470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.921470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.921470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.921470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.921727] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0689c8e1-5a9e-42bc-905e-8bedad0801e4 is going to be updated. [ 883.948012] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.948345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.948471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.949632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.951046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.951046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0689c8e1-5a9e-42bc-905e-8bedad0801e4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.272379] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd in Status: SUCCESS [ 884.272664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.272820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.273137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.273350] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.273647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.273647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.273877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.274026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.274126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.274217] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.392307] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e03b40fb-01ef-40a2-8d18-b763e5ce28be: rpc.has_security_group_logging(os_id): False [ 884.418956] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.419200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.419200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.419410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.419496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.419698] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.419803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.419868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.420041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.420120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.420316] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.420414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.420476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.420619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.420702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.420968] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.421063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.423396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.423396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.423396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.423396] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be is going to be updated. [ 884.424489] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.507482] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.507482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.507482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.507482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.507482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.633332] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: IN_PROGRESS for 2s [ 884.764134] env[65087]: INFO networking_nsxv3.common.synchronization [req-90f91a03-eb8d-42d0-acaf-d9fac0580afc req-23e696a3-f295-47e2-82ac-36546b866699 tempest-ServersTestManualDisk-848731207 tempest-ServersTestManualDisk-848731207-project-member] Enqueued Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_members [ 884.764401] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_members [ 884.764888] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dac161d-87bb-4f31-a632-3c3213ca7adf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.765196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.767546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.767546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.767546] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.767546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.767546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.767546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.767546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.767546] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.779112] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd4d842-afe8-4003-a8ee-07600ff1edfd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.779354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.779354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.779551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.779716] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.779819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.779869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.780126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.780126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.780264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.780327] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd4d842-afe8-4003-a8ee-07600ff1edfd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.780414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.780472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.780603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.780747] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.780862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.780925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.781076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.781153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.781231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.781332] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.930249] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.930249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.930249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.930249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.930249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.930249] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 is going to be created. [ 884.959309] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.959309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.959309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.959309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.959309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.972420] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4620817-a8af-47ab-8dc5-45c9281feca7 in Status: UNINITIALIZED for 2s [ 885.205339] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.205778] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-472" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.205778] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-472" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.206653] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-472" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.206653] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.206971] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.206971] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.207662] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.207662] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.207662] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.207662] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.207957] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.207957] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.207957] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.208168] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.208168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.238586] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.238586] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.238586] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.238924] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-472" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.240067] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.240067] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.240067] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.240367] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.241457] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e152c28-6b59-4a9d-84fc-8d01fe611d2d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.269392] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.269702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.269791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.270167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.270280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.270767] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.270767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.270767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.270982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.271094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.271193] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf already deleted. [ 885.271495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.283652] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dd4d842-afe8-4003-a8ee-07600ff1edfd: rpc.has_security_group_logging(os_id): False [ 885.305876] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.306077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.306157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.306477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.306586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.306785] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.306909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.306996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.307205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.307289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.307502] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.307624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.307724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.307904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.307993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.308245] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.308396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.308479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.308649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.308781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.308857] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd is going to be created. [ 885.408133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.408133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.408133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.408133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.408417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.421262] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd in Status: IN_PROGRESS for 2s [ 885.744823] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.745169] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.745999] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.745999] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.745999] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.746163] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 4e152c28-6b59-4a9d-84fc-8d01fe611d2d not found, creating... [ 885.746362] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.747286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.747286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.747286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.747403] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.747878] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.748174] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.748390] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.750440] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.750440] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.750440] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 4e152c28-6b59-4a9d-84fc-8d01fe611d2d is going to be created. [ 885.769311] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.769572] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.769736] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.770070] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.770362] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.770631] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.575024] env[65087]: INFO networking_nsxv3.common.synchronization [req-90f91a03-eb8d-42d0-acaf-d9fac0580afc req-75425da9-214e-41c1-8afb-a88439493ed7 service nova] Enqueued Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_rules [ 886.575024] env[65087]: INFO networking_nsxv3.common.synchronization [req-90f91a03-eb8d-42d0-acaf-d9fac0580afc req-75425da9-214e-41c1-8afb-a88439493ed7 service nova] Enqueued Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_members [ 886.575024] env[65087]: INFO networking_nsxv3.common.synchronization [req-90f91a03-eb8d-42d0-acaf-d9fac0580afc req-75425da9-214e-41c1-8afb-a88439493ed7 service nova] Enqueued Resource ID: 4e152c28-6b59-4a9d-84fc-8d01fe611d2d with Priority: HIGHEST for action port [ 886.576132] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_rules [ 886.579025] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_members [ 886.579025] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e152c28-6b59-4a9d-84fc-8d01fe611d2d with Priority: HIGHEST for action port [ 886.579025] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dac161d-87bb-4f31-a632-3c3213ca7adf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.579025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.579025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.579025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.579025] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.579025] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dac161d-87bb-4f31-a632-3c3213ca7adf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.580208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.580352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.580638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.581230] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.581524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.581689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.581994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.582262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.582569] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.583689] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.583939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.584115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.584357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.584511] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e152c28-6b59-4a9d-84fc-8d01fe611d2d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.643731] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: SUCCESS [ 886.644119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.984025] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4620817-a8af-47ab-8dc5-45c9281feca7 in Status: SUCCESS [ 886.984025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.984025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.984025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.984025] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.984025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.984025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.984025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.984025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.984025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.984025] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.086449] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dac161d-87bb-4f31-a632-3c3213ca7adf taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.086629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.086819] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.087936] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e152c28-6b59-4a9d-84fc-8d01fe611d2d with status ACTIVE [ 887.088420] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.088420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.088420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.088591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.088701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.090536] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.090536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.090536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.090536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.090536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.090536] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.090536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.090536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.090536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.090536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.090536] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e152c28-6b59-4a9d-84fc-8d01fe611d2d is going to be updated. [ 887.113872] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.114101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.114208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.114452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.114643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.114807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e152c28-6b59-4a9d-84fc-8d01fe611d2d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.303397] env[65087]: INFO networking_nsxv3.common.synchronization [req-77081d7c-e9d0-4ede-aeb3-4276361b3272 req-20fd9e5f-0f0f-4aae-8e27-32327de68011 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_members [ 887.304089] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_members [ 887.304437] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d415299-ca3d-4305-942b-69b3b58ccb49 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.304612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.304612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.305010] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.305393] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.305393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.305393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.306463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.306666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.306852] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.438114] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd in Status: SUCCESS [ 887.438330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.486254] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.592903] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.723025] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.723025] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.723025] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.723025] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.723025] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.723025] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.723981] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.727198] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.727198] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.727198] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.727198] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.727198] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.727198] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.727198] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.727198] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.727198] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.749792] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.749792] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.749792] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.749792] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.749792] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-230d5794-8d1b-4b48-b38a-e599cb5ba492 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.749792] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-230d5794-8d1b-4b48-b38a-e599cb5ba492" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.750251] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-230d5794-8d1b-4b48-b38a-e599cb5ba492" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.750870] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-230d5794-8d1b-4b48-b38a-e599cb5ba492" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.750870] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('230d5794-8d1b-4b48-b38a-e599cb5ba492',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.809482] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.809692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.809767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.810154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.810247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.810863] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.810863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.810863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.810863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.811052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.811052] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 already deleted. [ 887.811119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.988745] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4620817-a8af-47ab-8dc5-45c9281feca7: rpc.has_security_group_logging(os_id): False [ 888.014184] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.014184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.014184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.014184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.014184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.014184] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.014184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.014184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.014184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.014184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.014184] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 is going to be created. [ 888.082100] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.083032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.083032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.084638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.084638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.098091] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4620817-a8af-47ab-8dc5-45c9281feca7 in Status: IN_PROGRESS for 2s [ 888.098477] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.098655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.098714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.098898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.098990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.099099] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf is going to be created. [ 888.133238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.133238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.133420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.133517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.133694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.149085] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf in Status: UNINITIALIZED for 2s [ 888.255222] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.255222] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.255222] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.255222] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.255222] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.255457] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 230d5794-8d1b-4b48-b38a-e599cb5ba492 not found, creating... [ 888.255757] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.255985] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.256242] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.256581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.256753] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.257125] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.257310] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.257427] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.257662] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.257804] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.257949] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 230d5794-8d1b-4b48-b38a-e599cb5ba492 is going to be created. [ 888.279612] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.279808] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.280072] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.280253] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.280502] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.280748] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-230d5794-8d1b-4b48-b38a-e599cb5ba492" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.026653] env[65087]: INFO networking_nsxv3.common.synchronization [req-77081d7c-e9d0-4ede-aeb3-4276361b3272 req-a1a5dcc6-c378-482d-8c49-fb5df3cfd38f service nova] Enqueued Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_rules [ 889.027709] env[65087]: INFO networking_nsxv3.common.synchronization [req-77081d7c-e9d0-4ede-aeb3-4276361b3272 req-a1a5dcc6-c378-482d-8c49-fb5df3cfd38f service nova] Enqueued Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_members [ 889.027709] env[65087]: INFO networking_nsxv3.common.synchronization [req-77081d7c-e9d0-4ede-aeb3-4276361b3272 req-a1a5dcc6-c378-482d-8c49-fb5df3cfd38f service nova] Enqueued Resource ID: 230d5794-8d1b-4b48-b38a-e599cb5ba492 with Priority: HIGHEST for action port [ 889.028156] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_rules [ 889.028281] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_members [ 889.028383] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 230d5794-8d1b-4b48-b38a-e599cb5ba492 with Priority: HIGHEST for action port [ 889.028712] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d415299-ca3d-4305-942b-69b3b58ccb49 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.028791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.028836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.029423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.029528] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.030589] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d415299-ca3d-4305-942b-69b3b58ccb49 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.030807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.030898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.031159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.031387] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.031502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.031738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.031926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.032036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.032132] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.035922] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-230d5794-8d1b-4b48-b38a-e599cb5ba492 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.035922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-230d5794-8d1b-4b48-b38a-e599cb5ba492" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.035922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-230d5794-8d1b-4b48-b38a-e599cb5ba492" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.035922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-230d5794-8d1b-4b48-b38a-e599cb5ba492" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.035922] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('230d5794-8d1b-4b48-b38a-e599cb5ba492',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.536065] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d415299-ca3d-4305-942b-69b3b58ccb49 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.536283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.538088] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 230d5794-8d1b-4b48-b38a-e599cb5ba492 with status ACTIVE [ 889.538337] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.538464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.538567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.538761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.538856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.539070] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.539261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.539261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.539378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.539442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.539604] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.539716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.539767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.539929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.540052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.540143] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 230d5794-8d1b-4b48-b38a-e599cb5ba492 is going to be updated. [ 889.541295] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.570086] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.570086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.570086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.570086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.570272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.570461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-230d5794-8d1b-4b48-b38a-e599cb5ba492" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.044657] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.119870] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4620817-a8af-47ab-8dc5-45c9281feca7 in Status: SUCCESS [ 890.119870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.161566] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf in Status: SUCCESS [ 890.161837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.161967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.162208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.162427] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.162614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.162732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.162938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.163046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.163141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.163235] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.547836] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.547836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.547836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.548094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.548551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.548551] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 is going to be created. [ 890.609472] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.609664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.609664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.609889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.610053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.622765] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 in Status: UNINITIALIZED for 2s [ 890.665992] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.173247] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5dac161d-87bb-4f31-a632-3c3213ca7adf: rpc.has_security_group_logging(os_id): False [ 891.196376] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.196596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.196644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.197308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.197308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.198894] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.198894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.198894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.198894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.198894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.198894] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf is going to be created. [ 891.284304] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.284480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.285313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.285313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.285313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.302512] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf in Status: IN_PROGRESS for 2s [ 892.634032] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 in Status: SUCCESS [ 892.634342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.634386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.635019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.635019] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.635019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.635389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.635389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.635389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.635472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.636030] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.059087] env[65087]: INFO networking_nsxv3.common.synchronization [req-659a5afa-ec0a-41ef-a341-e386d689a428 req-d59b6a32-6d67-49be-844f-f633db8d681b tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 893.059716] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 893.060327] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.060327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.060327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.060509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.060594] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.060732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.060777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.060893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.060981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.061090] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.137722] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.316759] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf in Status: SUCCESS [ 893.317173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.526024] env[65087]: INFO networking_nsxv3.common.synchronization [req-a1fd0b93-1892-41e7-8b49-10ac0e7ce7b8 req-c5ef49d4-aca0-4f65-8a8b-c3a82bbab3f2 tempest-ServersAdminTestJSON-1882897549 tempest-ServersAdminTestJSON-1882897549-project-member] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 893.526701] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 893.529463] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.529463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.529463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.529463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.529463] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.529463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.529463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.529463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.529463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.529463] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.563738] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.564102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.564102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.564286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.564383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.564690] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.564894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.564957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.565148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.565217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.565373] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 893.599084] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.599247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.599328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.599715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.599715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.612945] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 893.640390] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d415299-ca3d-4305-942b-69b3b58ccb49: rpc.has_security_group_logging(os_id): False [ 893.670631] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.670631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.670631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.670631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.670631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.670631] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.670631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.670631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.670631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.670631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.670631] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 is going to be created. [ 893.749143] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.754050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.754050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.754050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.754050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.768104] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 in Status: IN_PROGRESS for 2s [ 894.032853] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.536752] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.040185] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.041095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.041178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.041515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.041577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.041638] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 895.088276] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.088565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.088629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.088880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.089045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.102755] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 895.626557] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 895.626557] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 895.626557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.783055] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 in Status: SUCCESS [ 895.783587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.112551] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 897.112849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.059593] env[65087]: INFO networking_nsxv3.common.synchronization [req-40c2c25e-9dcd-4778-a244-fbe0cf3c78f5 req-ae4803be-8016-42b0-b85e-b6653242c735 tempest-ServerMetadataTestJSON-465670558 tempest-ServerMetadataTestJSON-465670558-project-member] Enqueued Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGHEST for action security_group_members [ 898.061065] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGHEST for action security_group_members [ 898.061065] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd4d842-afe8-4003-a8ee-07600ff1edfd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.061065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.061065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.061065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.061540] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.061540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.061540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.061540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.061748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.061748] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.563987] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.564407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.564407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.564521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.564521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.564815] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.564922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.564979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.565149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.565229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.565317] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd is going to be updated. [ 898.598126] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.598705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.598806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.598991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.599175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.608946] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd in Status: IN_PROGRESS for 2s [ 900.620634] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd in Status: SUCCESS [ 900.620868] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd deletion is rescheduled due to dependency. [ 900.620943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.197845] env[65087]: INFO networking_nsxv3.common.synchronization [req-40512c38-1785-4870-a59b-12cae21bee47 req-50b84591-6d05-4fae-89ca-8a24b7b7c5fa tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 901.198449] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 901.198527] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.198580] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.198660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.198854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.199035] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.199154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.199218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.199375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.199460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.199554] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.627287] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.627627] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.627682] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.627935] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.628217] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.628377] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.628494] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.628707] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.628852] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.629078] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.629227] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.629338] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.629447] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.629558] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.629664] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.629798] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.649174] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.649382] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.649440] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.649602] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-852" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.649940] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-d94aace6-914d-4583-8957-01531edd38c7 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.650134] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-d94aace6-914d-4583-8957-01531edd38c7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.650254] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-d94aace6-914d-4583-8957-01531edd38c7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.650604] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-d94aace6-914d-4583-8957-01531edd38c7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.650747] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d94aace6-914d-4583-8957-01531edd38c7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.702054] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.702254] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.702662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.702951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.703066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.703272] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.703381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.703446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.703598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.703676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.703762] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 901.734453] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.734730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.734730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.735093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.735142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.745778] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 901.794972] env[65087]: INFO networking_nsxv3.common.synchronization [req-800fa915-5ff9-47ea-b5b2-71b7a55b09c0 req-6515fbc5-e3ec-4058-a938-93a47230829f tempest-MigrationsAdminTest-836415837 tempest-MigrationsAdminTest-836415837-project-member] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 901.795713] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGHEST for action security_group_members [ 901.796028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.796155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.796225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.796421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.796573] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.796670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.796734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.796892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.796978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.797198] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.152849] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.153371] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.153604] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.153944] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.154130] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.154295] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port d94aace6-914d-4583-8957-01531edd38c7 not found, creating... [ 902.154597] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.154838] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.154962] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.155207] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.155346] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.155640] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.155867] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.155990] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.156262] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.156436] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.156565] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: d94aace6-914d-4583-8957-01531edd38c7 is going to be created. [ 902.176067] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.176325] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.176388] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.176753] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.176909] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.177232] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-d94aace6-914d-4583-8957-01531edd38c7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.300937] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.301171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.301273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.301466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.301565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.301849] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.301967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.302039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.302185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.302261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.302384] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be updated. [ 902.346810] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.347054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.347054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.347279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.347430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.357459] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: IN_PROGRESS for 2s [ 902.872521] env[65087]: INFO networking_nsxv3.common.synchronization [req-40512c38-1785-4870-a59b-12cae21bee47 req-db707497-52f0-4c43-8599-4893c394b9be service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 902.872838] env[65087]: INFO networking_nsxv3.common.synchronization [req-40512c38-1785-4870-a59b-12cae21bee47 req-db707497-52f0-4c43-8599-4893c394b9be service nova] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 902.872838] env[65087]: INFO networking_nsxv3.common.synchronization [req-40512c38-1785-4870-a59b-12cae21bee47 req-db707497-52f0-4c43-8599-4893c394b9be service nova] Enqueued Resource ID: d94aace6-914d-4583-8957-01531edd38c7 with Priority: HIGHEST for action port [ 902.873540] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_rules [ 902.873752] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 902.873914] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94aace6-914d-4583-8957-01531edd38c7 with Priority: HIGHEST for action port [ 902.874342] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.874520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.874831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.874919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.875111] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.876668] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.876668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.876809] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d94aace6-914d-4583-8957-01531edd38c7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.876871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d94aace6-914d-4583-8957-01531edd38c7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.876934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d94aace6-914d-4583-8957-01531edd38c7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.877250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d94aace6-914d-4583-8957-01531edd38c7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.877345] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d94aace6-914d-4583-8957-01531edd38c7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.379507] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.379639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.379820] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d94aace6-914d-4583-8957-01531edd38c7 with status ACTIVE [ 903.380024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.380165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.380233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.380442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.380529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.380724] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.380855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.380925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.381118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.381212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.381438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.381546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.381609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.381751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.381827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.381911] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d94aace6-914d-4583-8957-01531edd38c7 is going to be updated. [ 903.427356] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.427545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.427674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.427925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.428081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.428248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d94aace6-914d-4583-8957-01531edd38c7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.757679] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 903.757879] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 deletion is rescheduled due to dependency. [ 903.758012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.758190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.758405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.758582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.758702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.758770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.758961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.759056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.759151] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.261323] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.367505] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 in Status: SUCCESS [ 904.368210] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 deletion is rescheduled due to dependency. [ 904.368210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.764442] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.267547] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.267547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.267547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.268185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.268185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.268185] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 905.312064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.312245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.312286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.312491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.312659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.322040] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 905.544541] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c0242a5-1280-4df8-a04f-a6a7cec29696 req-479b622f-83a8-4308-987f-eac04ce79bf5 tempest-ListImageFiltersTestJSON-1884000138 tempest-ListImageFiltersTestJSON-1884000138-project-member] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 905.544541] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGHEST for action security_group_members [ 905.544541] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.544541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.544541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.544541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.545475] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.545593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.545659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.545876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.545963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.546073] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.048832] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.049083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.049183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.049974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.071925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.072260] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.072765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.072818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.073718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.073718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.073718] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb is going to be updated. [ 906.118044] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.118212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.118271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.118480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.118624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.127747] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: IN_PROGRESS for 2s [ 907.333502] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 907.334179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.334380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.334605] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.334888] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.335501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.335594] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.587952] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.587952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.587952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.587952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.590334] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.590726] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.590904] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.591163] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.591364] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.591552] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.591667] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.591778] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.591885] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.591994] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.592117] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.592250] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.615714] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.615714] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.615944] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.616055] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.616662] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-e6af5536-4390-40ae-bef6-ddd069231d96 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.616662] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.616824] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.617035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.617214] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6af5536-4390-40ae-bef6-ddd069231d96',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.838202] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.838471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.838471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.838760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.838914] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.839074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.839165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.839337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.839428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.839518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.839672] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.839809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.839882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.840073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.840221] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.840323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.840429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.840577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.840656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.840853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.840906] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.121147] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.121147] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.121446] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.121526] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.121682] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.121990] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.122180] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.122291] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.122519] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.122684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.122989] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.123163] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.123281] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.123501] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.123734] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.123808] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: e6af5536-4390-40ae-bef6-ddd069231d96 is going to be updated. [ 908.141098] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb in Status: SUCCESS [ 908.141253] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb deletion is rescheduled due to dependency. [ 908.141253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.161030] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.161030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.161030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.161030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.161624] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.161624] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.344061] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae0af2af-9718-4a7b-876d-92e1124cdbd2: rpc.has_security_group_logging(os_id): False [ 908.364650] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.364883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.364959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.365258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.365394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.365654] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.365755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.365817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.365995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.366100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.366319] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.366437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.366562] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.366802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.366802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.366998] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.367162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.367162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.367288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.367375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.367491] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 908.438436] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.438590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.438662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.438871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.439058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.453938] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 908.831034] env[65087]: INFO networking_nsxv3.common.synchronization [req-dd9becf1-d41f-4cc5-958f-6bcfce9d0f0e req-5afdb486-d8f8-4f20-85dd-afb24be78717 service nova] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_rules [ 908.831199] env[65087]: INFO networking_nsxv3.common.synchronization [req-dd9becf1-d41f-4cc5-958f-6bcfce9d0f0e req-5afdb486-d8f8-4f20-85dd-afb24be78717 service nova] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_members [ 908.831929] env[65087]: INFO networking_nsxv3.common.synchronization [req-dd9becf1-d41f-4cc5-958f-6bcfce9d0f0e req-5afdb486-d8f8-4f20-85dd-afb24be78717 service nova] Enqueued Resource ID: e6af5536-4390-40ae-bef6-ddd069231d96 with Priority: HIGHEST for action port [ 908.832441] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_rules [ 908.832441] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_members [ 908.832960] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6af5536-4390-40ae-bef6-ddd069231d96 with Priority: HIGHEST for action port [ 908.833183] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.833431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.833431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.833600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.833681] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.834820] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.834820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.834820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.834974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.837462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.837462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.837462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.837462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.837462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.837462] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.837462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6af5536-4390-40ae-bef6-ddd069231d96 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.837462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.837462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.837462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.837462] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6af5536-4390-40ae-bef6-ddd069231d96',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.922045] env[65087]: INFO networking_nsxv3.common.synchronization [req-02407924-fb14-40f1-8e7f-cd4e4b78bb28 req-228a77fd-60b7-4175-bfe5-381741093474 tempest-ServerRescueTestJSON-1537167573 tempest-ServerRescueTestJSON-1537167573-project-member] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 908.922045] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 908.922259] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.922259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.922525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.922610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.922795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.922908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.922971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.923202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.923343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.923449] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.340788] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6af5536-4390-40ae-bef6-ddd069231d96 with status ACTIVE [ 909.340788] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.340788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.340788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.341258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.341258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.341258] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.341376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.341460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.341632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.341706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.341881] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.341990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.342066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.342210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.342284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.342367] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6af5536-4390-40ae-bef6-ddd069231d96 is going to be updated. [ 909.343834] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.343933] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.344173] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.370471] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.370622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.370707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.370922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.371285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.371285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6af5536-4390-40ae-bef6-ddd069231d96" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.426083] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.846605] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.929748] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.349481] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.349817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.349817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.349973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.350080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.350179] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ae9556d-2824-4426-9646-69904ca4036b is going to be updated. [ 910.383917] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.384073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.384110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.384300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.384447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.394811] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: IN_PROGRESS for 2s [ 910.433716] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.433886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.433992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.434223] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.434318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.434419] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be is going to be updated. [ 910.480095] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 910.480367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.486759] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.486907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.487149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.487256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.487497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.499143] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: IN_PROGRESS for 2s [ 912.405770] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: SUCCESS [ 912.406060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.406237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.406428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.406627] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.407268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.407268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.407268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.407268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.407268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.407268] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.509649] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: SUCCESS [ 912.509958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.909410] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.412257] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ae9556d-2824-4426-9646-69904ca4036b: rpc.has_security_group_logging(os_id): False [ 913.434582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.434866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.434912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.435186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.435286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.435560] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.435703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.435758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.435973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.436088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.436181] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ae9556d-2824-4426-9646-69904ca4036b is going to be updated. [ 913.556278] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.556485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.556584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.556892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.557159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.570808] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: IN_PROGRESS for 2s [ 913.923375] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 913.923565] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 915.325759] env[65087]: INFO networking_nsxv3.common.synchronization [req-522ac23c-10d1-4713-bc44-2eca4c76b654 req-6e515b2b-2b1e-43ec-aefd-35677bf84964 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 915.327074] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 915.327074] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.327074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.327074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.327300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.327333] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.327857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.327934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.328116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.328206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.328307] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.586303] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: SUCCESS [ 915.586809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.708772] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.709683] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.709683] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.709683] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.710121] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.710549] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.710549] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.711600] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.711600] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.711600] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.711600] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.711600] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.711600] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.711908] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.711908] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.712864] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.739446] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.739645] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.740353] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.740353] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.740496] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.741753] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.741753] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.741753] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.741753] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f4f6a5f-6472-4cf8-b968-3bbe4fb30962',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.831311] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.831529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.832171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.832171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.832171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.832171] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.832830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.832830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.832830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.832830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.832830] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 915.862295] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.862489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.862600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.863036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.863248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.874631] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 916.244388] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.244663] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.244881] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.245207] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.245360] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.245545] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 4f4f6a5f-6472-4cf8-b968-3bbe4fb30962 not found, creating... [ 916.245973] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.246161] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.246324] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.246750] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.246954] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.247378] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.247648] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.247765] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.248097] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.248350] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.248518] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 4f4f6a5f-6472-4cf8-b968-3bbe4fb30962 is going to be created. [ 916.279384] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.279763] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.280047] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.280419] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.280673] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.280915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.997483] env[65087]: INFO networking_nsxv3.common.synchronization [req-522ac23c-10d1-4713-bc44-2eca4c76b654 req-44655cfa-426c-4cd2-b494-afc271ed77c4 service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 916.997963] env[65087]: INFO networking_nsxv3.common.synchronization [req-522ac23c-10d1-4713-bc44-2eca4c76b654 req-44655cfa-426c-4cd2-b494-afc271ed77c4 service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 916.998178] env[65087]: INFO networking_nsxv3.common.synchronization [req-522ac23c-10d1-4713-bc44-2eca4c76b654 req-44655cfa-426c-4cd2-b494-afc271ed77c4 service nova] Enqueued Resource ID: 4f4f6a5f-6472-4cf8-b968-3bbe4fb30962 with Priority: HIGHEST for action port [ 916.998781] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 916.998969] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 916.999125] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4f6a5f-6472-4cf8-b968-3bbe4fb30962 with Priority: HIGHEST for action port [ 916.999873] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.000072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.000164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.000432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.000543] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.001752] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.001830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.002078] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.002754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.002754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.002754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.002754] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f4f6a5f-6472-4cf8-b968-3bbe4fb30962',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.505090] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.505162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.505331] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f4f6a5f-6472-4cf8-b968-3bbe4fb30962 with status ACTIVE [ 917.505510] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.505621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.505689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.506017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.506146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.506329] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.506431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.506498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.506896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.506896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.506896] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.507041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.507071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.507235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.507317] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.507407] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f4f6a5f-6472-4cf8-b968-3bbe4fb30962 is going to be updated. [ 917.528707] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.528862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.528939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.529173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.529535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.529576] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f4f6a5f-6472-4cf8-b968-3bbe4fb30962" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.884338] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 917.884544] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 917.884660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.884879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.885126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.885311] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.885634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.885634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.885700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.885753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.885882] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.967097] env[65087]: INFO networking_nsxv3.common.synchronization [req-697487e7-d5d4-40b1-a955-4804b4323c4e req-ea3ecfe6-1ed7-4de2-aded-dc590df0a6bf tempest-DeleteServersAdminTestJSON-1251840204 tempest-DeleteServersAdminTestJSON-1251840204-project-member] Enqueued Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 917.967654] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 917.967960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.968102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.968172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.968426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.968578] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.968674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.968736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.968886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.968971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.969073] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.332416] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.332724] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.332964] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.333384] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.333785] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.334306] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.334523] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.335320] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.335575] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.335881] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.336111] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.336315] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.336469] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.336652] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.336952] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.337196] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.356854] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.357104] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.357413] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.357642] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.358009] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-506848c2-a135-4c87-bb6e-4fb7cf640acd taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.358274] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-506848c2-a135-4c87-bb6e-4fb7cf640acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.358432] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-506848c2-a135-4c87-bb6e-4fb7cf640acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.358801] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-506848c2-a135-4c87-bb6e-4fb7cf640acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.359117] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('506848c2-a135-4c87-bb6e-4fb7cf640acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.387886] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.472071] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.472071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.472071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.472405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.472405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.472492] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.472561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.472699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.472780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.472877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.473060] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 already deleted. [ 918.473159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.862033] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.862339] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.862475] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.862755] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.862906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.863085] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 506848c2-a135-4c87-bb6e-4fb7cf640acd not found, creating... [ 918.863367] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.863528] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.863645] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.863868] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.864019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.864311] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.864468] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.864587] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.864791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.864952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.865112] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 506848c2-a135-4c87-bb6e-4fb7cf640acd is going to be created. [ 918.887931] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.888452] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.888653] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.889073] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.889460] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.889819] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-506848c2-a135-4c87-bb6e-4fb7cf640acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.890786] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.396229] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.396639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.396639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.396794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.396849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.396987] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 919.431181] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.431407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.431407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.431623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.431819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.441134] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 919.618034] env[65087]: INFO networking_nsxv3.common.synchronization [req-697487e7-d5d4-40b1-a955-4804b4323c4e req-e1510879-98f6-4dc5-94a4-6f0a3de9c132 service nova] Enqueued Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_rules [ 919.618147] env[65087]: INFO networking_nsxv3.common.synchronization [req-697487e7-d5d4-40b1-a955-4804b4323c4e req-e1510879-98f6-4dc5-94a4-6f0a3de9c132 service nova] Enqueued Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 919.618297] env[65087]: INFO networking_nsxv3.common.synchronization [req-697487e7-d5d4-40b1-a955-4804b4323c4e req-e1510879-98f6-4dc5-94a4-6f0a3de9c132 service nova] Enqueued Resource ID: 506848c2-a135-4c87-bb6e-4fb7cf640acd with Priority: HIGHEST for action port [ 919.618901] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_rules [ 919.619086] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 919.619273] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506848c2-a135-4c87-bb6e-4fb7cf640acd with Priority: HIGHEST for action port [ 919.619561] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.619695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.619766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.620039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.620132] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.621186] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.621304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.621396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.621619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.621776] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.621874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.621934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.622106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.622194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.622431] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.623220] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-506848c2-a135-4c87-bb6e-4fb7cf640acd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.623340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-506848c2-a135-4c87-bb6e-4fb7cf640acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.623611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-506848c2-a135-4c87-bb6e-4fb7cf640acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.623611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-506848c2-a135-4c87-bb6e-4fb7cf640acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.623611] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('506848c2-a135-4c87-bb6e-4fb7cf640acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.125560] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.127118] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.127271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.127670] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 506848c2-a135-4c87-bb6e-4fb7cf640acd with status ACTIVE [ 920.128825] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.128825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.128825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.128825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.128825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.128825] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.128825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.129478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.129478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.129478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.129478] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.129478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.129651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.129679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.129788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.129843] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 506848c2-a135-4c87-bb6e-4fb7cf640acd is going to be updated. [ 920.153837] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.153990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.154086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.154293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.154432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.154594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-506848c2-a135-4c87-bb6e-4fb7cf640acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.629438] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.133034] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.133034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.133034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.133976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.134388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.134480] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 is going to be created. [ 921.163044] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.163044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.163044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.163320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.163320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.173485] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: UNINITIALIZED for 2s [ 921.451634] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 921.451861] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.452051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.452277] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.452600] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.452600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.452745] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.452928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.452928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.453218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.453218] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.956106] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.956500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.956500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.956803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.956932] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.957047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.957113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.957353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.957442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.957532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.957683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.957780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.957849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.957994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.958139] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.958217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.958284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.958413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.958491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.958576] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.958665] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.461645] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e5af08c-4029-463c-937e-2ea7bf68d7d1: rpc.has_security_group_logging(os_id): False [ 922.481740] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.481896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.481999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.482212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.482305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.482549] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.482703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.482798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.482898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.482978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.483171] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.483266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.483326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.483551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.483551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.483719] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.483796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.483913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.484075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.484152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.484239] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 922.553304] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.553451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.553538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.553733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.553882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.567586] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 923.184943] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: SUCCESS [ 923.184943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.184943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.184943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.184943] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.184943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.184943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.185366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.185366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.185366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.185366] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.687997] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.688206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.688287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.688575] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.688782] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.688937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.689045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.689249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.689367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.689485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.689670] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.689782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.689851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.690042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.690608] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.690778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.690867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.691134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.691255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.691370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.691482] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.193673] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d58a5975-db0d-4e76-84b4-0eaa1b1c8688: rpc.has_security_group_logging(os_id): False [ 924.215027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.215027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.215027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.215027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.216234] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.216546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.216739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.217010] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.218711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.218711] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 is going to be created. [ 924.281588] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.281827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.281914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.282142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.282331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.293946] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: IN_PROGRESS for 2s [ 924.582674] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 924.584254] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.620158] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 924.620158] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 925.110555] env[65087]: INFO networking_nsxv3.common.synchronization [req-a421ad19-8e0d-4cc8-8455-6182305fe95a req-30418304-7c6f-406d-88d7-c5f48f93241a tempest-ServersAdminTestJSON-1882897549 tempest-ServersAdminTestJSON-1882897549-project-member] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 925.112148] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 925.112148] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.112148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.112148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.112729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.112901] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.112999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.113071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.113259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.113349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.113447] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.615443] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.118638] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.309330] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: SUCCESS [ 926.309330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.582969] env[65087]: INFO networking_nsxv3.common.synchronization [req-9a83d240-5923-4f48-ab60-8049f6a48434 req-89ee728a-c031-4ac4-9c48-97aee9fc0400 tempest-ImagesTestJSON-1150296449 tempest-ImagesTestJSON-1150296449-project-member] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 926.582969] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGHEST for action security_group_members [ 926.582969] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.583373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.583373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.583373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.583505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.583633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.583750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.583895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.584047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.584311] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.623623] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.624032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.624032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.624313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.624656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.624656] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 926.660361] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.660622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.660733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.660970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.661202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.671664] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 927.089947] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.089947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.089947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.089947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.089947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.089947] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.089947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.089947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.089947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.089947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.089947] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be updated. [ 927.131233] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.131390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.131471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.131721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.131900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.148375] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: IN_PROGRESS for 2s [ 928.682074] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 928.682325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.793469] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc24de93-6970-4296-961e-3699ed2cf5ee req-aaa72b1d-96d0-4cd4-b44b-58aff7064664 tempest-ListServerFiltersTestJSON-16229912 tempest-ListServerFiltersTestJSON-16229912-project-member] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 928.794080] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 928.794411] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.794542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.794613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.794973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.795209] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.795391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.795515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.795764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.795915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.796072] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.119625] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.119829] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.119971] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.120357] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.120622] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.120796] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.123576] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.123576] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.123576] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.123576] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.123576] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.123576] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.123576] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.123576] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 929.123576] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.123576] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.144165] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.144379] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 929.144591] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.144691] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.145166] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-9880c5e4-9fd1-43a7-b1ec-71fd90124728 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.145311] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-9880c5e4-9fd1-43a7-b1ec-71fd90124728" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.145474] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-9880c5e4-9fd1-43a7-b1ec-71fd90124728" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.146741] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-9880c5e4-9fd1-43a7-b1ec-71fd90124728" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.146741] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9880c5e4-9fd1-43a7-b1ec-71fd90124728',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.158788] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 in Status: SUCCESS [ 929.158788] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 deletion is rescheduled due to dependency. [ 929.158788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.298805] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.298971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.299066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.299296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.299390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.299584] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.299686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.299781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.299900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.299979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.300079] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc already deleted. [ 929.300174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.648359] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.648632] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.648793] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.649159] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.649398] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.649950] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 9880c5e4-9fd1-43a7-b1ec-71fd90124728 not found, creating... [ 929.650318] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.650798] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.650918] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.651184] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.651360] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.652192] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.652192] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.652349] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.652590] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.652750] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.652893] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 9880c5e4-9fd1-43a7-b1ec-71fd90124728 is going to be created. [ 929.675350] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.675575] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.675703] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.676040] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.676438] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.676527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-9880c5e4-9fd1-43a7-b1ec-71fd90124728" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.459190] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc24de93-6970-4296-961e-3699ed2cf5ee req-a856e6bd-2947-496b-a3e5-edd75f90b8eb service nova] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_rules [ 930.459512] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc24de93-6970-4296-961e-3699ed2cf5ee req-a856e6bd-2947-496b-a3e5-edd75f90b8eb service nova] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 930.459743] env[65087]: INFO networking_nsxv3.common.synchronization [req-dc24de93-6970-4296-961e-3699ed2cf5ee req-a856e6bd-2947-496b-a3e5-edd75f90b8eb service nova] Enqueued Resource ID: 9880c5e4-9fd1-43a7-b1ec-71fd90124728 with Priority: HIGHEST for action port [ 930.460290] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_rules [ 930.460428] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 930.460524] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9880c5e4-9fd1-43a7-b1ec-71fd90124728 with Priority: HIGHEST for action port [ 930.460801] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.460922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.461041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.461260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.461344] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.462565] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.462683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.462823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.463362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.463362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.463480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.463480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.464709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.464875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.465176] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.466377] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-9880c5e4-9fd1-43a7-b1ec-71fd90124728 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.466377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9880c5e4-9fd1-43a7-b1ec-71fd90124728" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.466377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9880c5e4-9fd1-43a7-b1ec-71fd90124728" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.466377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9880c5e4-9fd1-43a7-b1ec-71fd90124728" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.467045] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9880c5e4-9fd1-43a7-b1ec-71fd90124728',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.970071] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.971457] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.971457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.971645] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9880c5e4-9fd1-43a7-b1ec-71fd90124728 with status ACTIVE [ 930.972354] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.972354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.972354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.972354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.972354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.972622] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.972622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.972622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.973035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.973035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.973133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.973515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.973515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.973515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.973515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.973653] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9880c5e4-9fd1-43a7-b1ec-71fd90124728 is going to be updated. [ 930.994899] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.995131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.995244] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.995867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.995867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.995867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9880c5e4-9fd1-43a7-b1ec-71fd90124728" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.386241] env[65087]: INFO networking_nsxv3.common.synchronization [req-bba17a02-91ff-4360-adad-180263453a9e req-8164f3a3-5f50-4f10-a004-ebfc49403da6 tempest-ListServerFiltersTestJSON-16229912 tempest-ListServerFiltersTestJSON-16229912-project-member] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 931.386241] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 931.386534] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.386638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.476247] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.829745] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.829946] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.830097] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.830366] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.830873] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.831090] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.831218] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.831476] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.831645] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.831850] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.831960] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 931.832079] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 931.832200] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 931.832294] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 931.832395] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 931.832543] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 931.854177] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 931.854336] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 931.854457] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 931.854633] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.855037] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.855210] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.855333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.855669] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.855812] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a9a9df3-e5cf-46b7-a471-7413c1bf6c81',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.978955] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.979156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.979207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.979423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.979516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.979614] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be created. [ 932.009387] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.009539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.009613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.009834] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.010020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.020196] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: UNINITIALIZED for 2s [ 932.359597] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.359597] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.359597] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.359597] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.359597] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.359597] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 3a9a9df3-e5cf-46b7-a471-7413c1bf6c81 not found, creating... [ 932.359597] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.360120] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.360120] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.360120] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.360268] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.360622] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.360622] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.360816] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.360900] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.361048] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.361190] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 3a9a9df3-e5cf-46b7-a471-7413c1bf6c81 is going to be created. [ 932.385451] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.385598] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.385724] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.386032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.386288] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.386853] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.462774] env[65087]: INFO networking_nsxv3.common.synchronization [req-9a5753ca-3509-4dc7-96d5-1661963c56c3 req-48f364ad-7a3e-4caf-93d6-bf6c1bbbcb10 tempest-ServerActionsV293TestJSON-527788909 tempest-ServerActionsV293TestJSON-527788909-project-member] Enqueued Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_members [ 932.463481] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 with Priority: HIGHEST for action security_group_members [ 932.463808] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-13c5346a-4114-4ee9-bda4-7f968a612f58 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.463941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.464030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.464247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.464404] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.464589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.464589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.464712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.464811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.464908] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13c5346a-4114-4ee9-bda4-7f968a612f58',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.840694] env[65087]: INFO networking_nsxv3.common.synchronization [req-061b95f1-a49c-4f9f-b713-f741eb462288 req-c79a5af2-8cd8-48c5-ab44-621b51b20662 tempest-DeleteServersAdminTestJSON-1928641739 tempest-DeleteServersAdminTestJSON-1928641739-project-admin] Enqueued Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 932.841256] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 932.841562] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.841688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.842785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.842785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.842785] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.842785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.842785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.842785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.842785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.842785] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.968372] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.968618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.968695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.969022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.969109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.969316] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.969428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.969494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.969661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.969742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.969829] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 is going to be updated. [ 932.998962] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.999112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.999298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.999399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.999534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.008690] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 in Status: IN_PROGRESS for 2s [ 933.102120] env[65087]: INFO networking_nsxv3.common.synchronization [req-bba17a02-91ff-4360-adad-180263453a9e req-74724333-ecc2-4b01-83ab-4acdd2f9b404 service nova] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_rules [ 933.102120] env[65087]: INFO networking_nsxv3.common.synchronization [req-bba17a02-91ff-4360-adad-180263453a9e req-74724333-ecc2-4b01-83ab-4acdd2f9b404 service nova] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 933.102245] env[65087]: INFO networking_nsxv3.common.synchronization [req-bba17a02-91ff-4360-adad-180263453a9e req-74724333-ecc2-4b01-83ab-4acdd2f9b404 service nova] Enqueued Resource ID: 3a9a9df3-e5cf-46b7-a471-7413c1bf6c81 with Priority: HIGHEST for action port [ 933.102674] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_rules [ 933.102800] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 933.102989] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a9a9df3-e5cf-46b7-a471-7413c1bf6c81 with Priority: HIGHEST for action port [ 933.103434] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.103434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.103655] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.103731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.103944] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.104045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.104045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.104485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.104485] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a9a9df3-e5cf-46b7-a471-7413c1bf6c81',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.347026] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.347026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.347026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.347026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.347026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.347026] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.347026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.347026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.347026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.347026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.347026] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 is going to be updated. [ 933.378915] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.379229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.379229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.379880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.379880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.388697] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: IN_PROGRESS for 2s [ 933.606396] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a9a9df3-e5cf-46b7-a471-7413c1bf6c81 with status ACTIVE [ 933.606863] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.607111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.607167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.607430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.607547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.607728] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.607876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.607876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.608059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.608131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.608267] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.608359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.608415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.608545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.608615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.608710] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a9a9df3-e5cf-46b7-a471-7413c1bf6c81 is going to be updated. [ 933.656476] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.656697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.656697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.656955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.657306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.657551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a9a9df3-e5cf-46b7-a471-7413c1bf6c81" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.955556] env[65087]: INFO networking_nsxv3.common.synchronization [req-a4ab3421-9fac-4410-afcb-c3586897eab6 req-8cebd68f-699d-4a8d-a075-a8990e3e19c7 tempest-ListServerFiltersTestJSON-16229912 tempest-ListServerFiltersTestJSON-16229912-project-member] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 933.956046] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 933.956046] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.956172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.033093] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 934.033340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.033515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.034289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.034289] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.034289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.034289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.034566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.034566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.034566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.034566] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.035509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.035695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.035885] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.036035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.036133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.036287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.036367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.036459] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.369257] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-663 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.370041] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.370041] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.370041] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.370368] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.370558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.370679] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.371486] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.371486] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.371622] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.372172] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.372172] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.372293] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.372528] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.372988] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.373245] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.413501] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.413682] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.413823] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.416235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-663" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.416235] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.416235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.416235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.416235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.416235] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.538748] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.538949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.540207] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.919585] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.919821] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.919948] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.920390] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.920564] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.920784] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d not found, creating... [ 934.921186] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.921697] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.921697] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.921790] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.921862] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.922208] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.922424] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.922553] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.922771] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.923010] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.923175] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d is going to be created. [ 934.945497] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.945742] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.945835] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.946212] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.946432] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.946680] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.035732] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 in Status: SUCCESS [ 935.036129] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13c5346a-4114-4ee9-bda4-7f968a612f58 deletion is rescheduled due to dependency. [ 935.036283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13c5346a-4114-4ee9-bda4-7f968a612f58" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.042976] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.409857] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: SUCCESS [ 935.410472] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 deletion is rescheduled due to dependency. [ 935.410472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.547841] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.548512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.548512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.548512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.548644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.548673] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 935.606344] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.606505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.606557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.606766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.606914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.632786] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 935.685496] env[65087]: INFO networking_nsxv3.common.synchronization [req-a4ab3421-9fac-4410-afcb-c3586897eab6 req-e22aeeaf-e7ba-4910-89d2-0af421f29909 service nova] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_rules [ 935.685674] env[65087]: INFO networking_nsxv3.common.synchronization [req-a4ab3421-9fac-4410-afcb-c3586897eab6 req-e22aeeaf-e7ba-4910-89d2-0af421f29909 service nova] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 935.685813] env[65087]: INFO networking_nsxv3.common.synchronization [req-a4ab3421-9fac-4410-afcb-c3586897eab6 req-e22aeeaf-e7ba-4910-89d2-0af421f29909 service nova] Enqueued Resource ID: 6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d with Priority: HIGHEST for action port [ 935.686397] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_rules [ 935.686538] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 935.686638] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d with Priority: HIGHEST for action port [ 935.686912] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.687264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.687618] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.687680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.687869] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.687973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.688050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.688265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.688344] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.194210] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d with status ACTIVE [ 936.194210] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.194210] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.194210] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.194210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.194210] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d is going to be updated. [ 936.221760] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.221760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.221760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.221760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.221760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.221760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e6622e0-7ff1-4894-a8b6-3a1ccd14a49d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.647944] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 937.647944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.647944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.647944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.647944] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.647944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.647944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.648409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.648409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.648409] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.151875] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.190280] env[65087]: INFO networking_nsxv3.common.synchronization [None req-1a5b5ba2-cd11-4552-9a2a-876c86641718 None None] Enqueued Resource ID: 64e1e813-e20f-483a-b61c-db15907bac13 with Priority: HIGHEST for action port [ 938.190983] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e1e813-e20f-483a-b61c-db15907bac13 with Priority: HIGHEST for action port [ 938.191475] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-64e1e813-e20f-483a-b61c-db15907bac13 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.191609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64e1e813-e20f-483a-b61c-db15907bac13" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.191835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64e1e813-e20f-483a-b61c-db15907bac13" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.192052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64e1e813-e20f-483a-b61c-db15907bac13" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.192052] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64e1e813-e20f-483a-b61c-db15907bac13',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.655431] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.695168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64e1e813-e20f-483a-b61c-db15907bac13 [ 938.696084] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.696463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.696722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.697227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.697359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.697754] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64e1e813-e20f-483a-b61c-db15907bac13 already deleted. [ 938.697754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64e1e813-e20f-483a-b61c-db15907bac13" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.159778] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.159778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.159778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.159778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.159778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.159778] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 939.193740] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.193740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.193740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.193740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.194013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.205085] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 941.218352] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 4s [ 941.329067] env[65087]: INFO networking_nsxv3.common.synchronization [req-24f2ac4d-dfd3-4498-93e4-cfab7a5f04e8 req-0b0a9a1c-dea7-4be9-b040-a9d9291e80e7 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 941.329408] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 941.330023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.332822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.332822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.332822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.332822] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.332822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.332822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.332822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.332822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.332822] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.836622] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.839345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.839345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.839345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.839345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.839345] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.839345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.839345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.839345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.839345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.839345] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 941.876187] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.876322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.876322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.877535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.877535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.891228] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 942.006113] env[65087]: INFO networking_nsxv3.common.synchronization [None req-3a6369f0-dded-4b97-affe-8aa5eafce4da None None] Enqueued Resource ID: 8cdeaa68-f6b3-44fd-99f7-37d8449f1717 with Priority: HIGHEST for action port [ 942.006389] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cdeaa68-f6b3-44fd-99f7-37d8449f1717 with Priority: HIGHEST for action port [ 942.007031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cdeaa68-f6b3-44fd-99f7-37d8449f1717 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.007154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cdeaa68-f6b3-44fd-99f7-37d8449f1717" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.007219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cdeaa68-f6b3-44fd-99f7-37d8449f1717" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.007565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cdeaa68-f6b3-44fd-99f7-37d8449f1717" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.007565] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cdeaa68-f6b3-44fd-99f7-37d8449f1717',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.295431] env[65087]: INFO networking_nsxv3.common.synchronization [req-c0857cf3-8d6b-4338-96f9-c6df82263ec5 req-616c9db5-c580-48fb-b0bf-1a7619fec9a0 tempest-ServerRescueTestJSON-1537167573 tempest-ServerRescueTestJSON-1537167573-project-member] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 942.296281] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGHEST for action security_group_members [ 942.296453] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.296566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.298919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.299232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.299768] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.299768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.299768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.299768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.300081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.300081] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.510037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cdeaa68-f6b3-44fd-99f7-37d8449f1717 [ 942.510284] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.510573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.510573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.510742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.510787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.510888] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cdeaa68-f6b3-44fd-99f7-37d8449f1717 already deleted. [ 942.511018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cdeaa68-f6b3-44fd-99f7-37d8449f1717" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.785502] env[65087]: INFO networking_nsxv3.common.synchronization [None req-3c35879d-56cd-449e-ad8b-b92b339e5dfb None None] Enqueued Resource ID: 365b13a8-d0a8-480a-93fe-5ebc3f39ef8b with Priority: HIGHEST for action port [ 942.785947] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365b13a8-d0a8-480a-93fe-5ebc3f39ef8b with Priority: HIGHEST for action port [ 942.786272] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-365b13a8-d0a8-480a-93fe-5ebc3f39ef8b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.786406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-365b13a8-d0a8-480a-93fe-5ebc3f39ef8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.786461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-365b13a8-d0a8-480a-93fe-5ebc3f39ef8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.786907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-365b13a8-d0a8-480a-93fe-5ebc3f39ef8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.786907] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('365b13a8-d0a8-480a-93fe-5ebc3f39ef8b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.805694] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.805920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.805920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.806196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.806299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.806519] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.806625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.806715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.806845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.806952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.807026] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be is going to be updated. [ 942.993173] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.993418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.993418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.993631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.993751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.005464] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: IN_PROGRESS for 2s [ 943.231014] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 943.231014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.231014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.231248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.231302] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.231436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.231502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.231620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.231697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.231786] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.291544] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 365b13a8-d0a8-480a-93fe-5ebc3f39ef8b [ 943.291787] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.291920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.291989] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.292226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.292318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.292542] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:365b13a8-d0a8-480a-93fe-5ebc3f39ef8b already deleted. [ 943.292643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-365b13a8-d0a8-480a-93fe-5ebc3f39ef8b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.459715] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-329 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.460074] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.460074] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.460341] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.460619] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.460804] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.461029] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.461160] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.461394] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.465025] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.465025] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.465025] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.465025] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.465025] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.465025] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.465025] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.491839] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.493873] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.493873] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.493873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-329" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.493873] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-aff05726-4c68-42cd-8887-b24f418b689d taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.493873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.493873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.493873] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.493873] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aff05726-4c68-42cd-8887-b24f418b689d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.737381] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.906441] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 943.906640] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 943.906760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.999190] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.999190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.999190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.999190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.999190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.999190] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.999190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.999190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.999190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.999190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.999558] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.999558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.999558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.999558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.000114] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.000422] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: aff05726-4c68-42cd-8887-b24f418b689d is going to be updated. [ 944.026256] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.026256] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.026256] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.026256] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.026256] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.026575] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.242898] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.737956] env[65087]: INFO networking_nsxv3.common.synchronization [req-048ca5f8-c3d5-4d72-aea0-12edebea3231 req-377c16dd-a64e-4933-a930-0ac4ffd6e337 service nova] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_rules [ 944.738261] env[65087]: INFO networking_nsxv3.common.synchronization [req-048ca5f8-c3d5-4d72-aea0-12edebea3231 req-377c16dd-a64e-4933-a930-0ac4ffd6e337 service nova] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 944.738391] env[65087]: INFO networking_nsxv3.common.synchronization [req-048ca5f8-c3d5-4d72-aea0-12edebea3231 req-377c16dd-a64e-4933-a930-0ac4ffd6e337 service nova] Enqueued Resource ID: aff05726-4c68-42cd-8887-b24f418b689d with Priority: HIGHEST for action port [ 944.738969] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_rules [ 944.739248] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 944.739248] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aff05726-4c68-42cd-8887-b24f418b689d with Priority: HIGHEST for action port [ 944.739535] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.739727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.739807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.740073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.740176] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.741371] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.741796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.741876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.742090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.742257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.742360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.742422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.742596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.742659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.742786] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.743908] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-aff05726-4c68-42cd-8887-b24f418b689d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.744517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.744517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.744517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.744517] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aff05726-4c68-42cd-8887-b24f418b689d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.745886] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.745984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.746097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.746393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.746393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.746701] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 944.803318] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.803586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.803586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.803827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.803886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.814748] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 945.017014] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be in Status: SUCCESS [ 945.017233] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be deletion is rescheduled due to dependency. [ 945.017356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.217305] env[65087]: INFO networking_nsxv3.common.synchronization [None req-a09f7a44-8f1a-4261-9120-07697c693cbf None None] Enqueued Resource ID: d797b5be-c6ae-45d5-8fce-484e63665fdf with Priority: HIGHEST for action port [ 945.218187] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d797b5be-c6ae-45d5-8fce-484e63665fdf with Priority: HIGHEST for action port [ 945.219081] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d797b5be-c6ae-45d5-8fce-484e63665fdf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.219081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d797b5be-c6ae-45d5-8fce-484e63665fdf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.219081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d797b5be-c6ae-45d5-8fce-484e63665fdf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.219081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d797b5be-c6ae-45d5-8fce-484e63665fdf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.219081] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d797b5be-c6ae-45d5-8fce-484e63665fdf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.246327] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.250033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.250033] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.250807] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aff05726-4c68-42cd-8887-b24f418b689d with status ACTIVE [ 945.251310] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.252411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.252841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.253201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.253411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.253730] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.253983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.254143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.254498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.254754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.255381] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.255651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.255846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.257031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.260630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.260630] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aff05726-4c68-42cd-8887-b24f418b689d is going to be updated. [ 945.291133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.291334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.291334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.291766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.291766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.293112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aff05726-4c68-42cd-8887-b24f418b689d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.334309] env[65087]: INFO networking_nsxv3.common.synchronization [None req-0e068231-48ff-4a54-99ae-f0e0b9775beb tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_rules [ 945.334309] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_rules [ 945.334309] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.334544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.334544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.335024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.335196] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.474562] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c959494b-5abc-47e4-ad0e-5a2439e560ae tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_rules [ 945.475568] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_rules [ 945.476016] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.476170] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.721128] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d797b5be-c6ae-45d5-8fce-484e63665fdf [ 945.721368] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.721505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.721573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.721914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.723504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.723504] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d797b5be-c6ae-45d5-8fce-484e63665fdf already deleted. [ 945.723504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d797b5be-c6ae-45d5-8fce-484e63665fdf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.759630] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.860173] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.860398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.860398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.861581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.861581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.861581] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e already deleted. [ 945.861581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.861581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.861581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.861581] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.263257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.263420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.263493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.263706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.263794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.263988] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be updated. [ 946.330371] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.330618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.330838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.331173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.331511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.344135] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: IN_PROGRESS for 2s [ 946.388251] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.388403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.388540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.388701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.388792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.388893] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e already deleted. [ 946.388976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.896740] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 946.897086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.897144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.897357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.897549] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.897668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.897737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.897885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.897971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.898063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.898226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.898299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.898360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.898498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.898630] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.898719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.898779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.898913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.898988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.899085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.899171] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.900054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.900220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.900388] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.900481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.900545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.900681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.900776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.900839] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.402444] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc: rpc.has_security_group_logging(os_id): False [ 947.404450] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.434939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.435176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.436038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.436038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.436038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.436038] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.436038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.436302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.436334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.436450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.436738] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.436844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.436907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.437151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.437266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.437523] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.437621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.437681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.437824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.437895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.438023] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be created. [ 947.503268] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.503429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.503505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.503881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.504090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.515099] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 947.907549] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.356631] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 948.356631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.356631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.357088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.357691] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.357691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.357691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.358123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.358123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.358123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.358265] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.410585] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.410585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.410585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.410585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.410764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.410764] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 948.441732] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.441931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.441931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.442183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.442333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.453030] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 948.677385] env[65087]: INFO networking_nsxv3.common.synchronization [req-a74d060d-bd47-4b6d-ab4b-7d3d6323773e req-11bc432c-dcaa-4fd8-8de6-d30acc3bbbfd tempest-ServersAdminTestJSON-1882897549 tempest-ServersAdminTestJSON-1882897549-project-member] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 948.677825] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGHEST for action security_group_members [ 948.678857] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.678857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.678857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.678857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.678857] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.678857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.678857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.679489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.679489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.679489] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.860797] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.861121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.861121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.861386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.861574] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.864058] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.864058] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.864058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.864058] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.183149] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.183548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.183548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.183699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.183799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.184068] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.184296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.184296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.184482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.184584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.184684] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be updated. [ 949.216305] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.216468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.216517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.216725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.216876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.227918] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: IN_PROGRESS for 2s [ 949.367187] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa843f83-ade7-475f-9e86-d1f12b4e1f38: rpc.has_security_group_logging(os_id): False [ 949.391234] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.391234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.391234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.391234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.391234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.391234] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.391234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.391234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.391234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.391602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.391602] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.391602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.391602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.391730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.393018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.393018] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.395166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.395398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.395614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.395713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.395803] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be updated. [ 949.496905] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.499130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.499130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.499130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.499130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.513444] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: IN_PROGRESS for 2s [ 949.527566] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 949.527566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.527566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.527566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.527566] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.030476] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.030476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.468713] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 950.469066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.469157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.469408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.469609] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.469734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.469820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.469958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.470082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.470177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.470274] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.974124] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.974260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.974331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.974721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.974721] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.975036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.975036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.975036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.975548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.975548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.975548] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.975548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.975548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.976029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.976029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.976029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.976029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.976582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.976582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.976582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.976582] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.240642] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f in Status: SUCCESS [ 951.240837] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f deletion is rescheduled due to dependency. [ 951.240886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.481548] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc: rpc.has_security_group_logging(os_id): False [ 951.503545] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.503545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.503545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.503833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.503909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.504174] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.504284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.504348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.504523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.504646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.505042] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.505042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.505042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.505261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.505261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.505387] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.505481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.505541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.505676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.505791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.505888] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 951.533890] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 951.533890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.587786] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.587977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.588074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.588294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.588443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.602978] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 953.346822] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c6c57e44-e12d-4171-a603-7ecb5950a9ae None None] Enqueued Resource ID: e01fb3b4-dba1-4d25-91bd-212be6e1efb1 with Priority: HIGHEST for action port [ 953.347825] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e01fb3b4-dba1-4d25-91bd-212be6e1efb1 with Priority: HIGHEST for action port [ 953.348296] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e01fb3b4-dba1-4d25-91bd-212be6e1efb1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.348296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e01fb3b4-dba1-4d25-91bd-212be6e1efb1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.348296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e01fb3b4-dba1-4d25-91bd-212be6e1efb1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.349023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e01fb3b4-dba1-4d25-91bd-212be6e1efb1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.349023] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e01fb3b4-dba1-4d25-91bd-212be6e1efb1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.622096] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 953.622741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.622741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.622959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.623076] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.854155] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e01fb3b4-dba1-4d25-91bd-212be6e1efb1 [ 953.854155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.854155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.854155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.854155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.854155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.854155] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e01fb3b4-dba1-4d25-91bd-212be6e1efb1 already deleted. [ 953.854155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e01fb3b4-dba1-4d25-91bd-212be6e1efb1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.127551] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.127551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.127551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.127551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.128083] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.128083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.128083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.128324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.128434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.128528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.128622] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.288598] env[65087]: INFO networking_nsxv3.common.synchronization [req-6991e486-a102-4d8e-aa52-509e4fa4e4b4 req-19a9e633-1b09-427c-9393-a5407d4ae940 tempest-ServersTestBootFromVolume-901464301 tempest-ServersTestBootFromVolume-901464301-project-member] Enqueued Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_members [ 954.289226] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGHEST for action security_group_members [ 954.290831] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.290831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.290831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.290831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.290831] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.291145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.291145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.291145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.291242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.291834] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.632330] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.632676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.632676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.632857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.632947] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.633065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.633191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.633421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.633553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.633655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.633812] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.633953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.634020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.634139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.634279] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.634371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.634431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.634571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.634843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.634843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.634843] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.795344] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.796377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.796591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.796960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.797177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.797600] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.797878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.798402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.798572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.798692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.798806] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 is going to be updated. [ 954.832036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.832036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.832036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.832036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.832036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.842987] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 in Status: IN_PROGRESS for 2s [ 955.137597] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc: rpc.has_security_group_logging(os_id): False [ 955.164202] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.164359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.164433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.164643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.164740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.164977] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.165169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.165252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.165409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.165489] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.165670] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.165770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.165839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.166070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.166070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.166359] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.166454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.166511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.166656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.166731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.166921] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 955.240902] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.241107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.241107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.242057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.242465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.268863] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 955.911165] env[65087]: INFO networking_nsxv3.common.synchronization [None req-aabb5e5c-ed30-45be-9e3c-291d377b0f2f None None] Enqueued Resource ID: a4cefab3-ab9a-4edc-bd53-097aa29dd08b with Priority: HIGHEST for action port [ 955.911790] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4cefab3-ab9a-4edc-bd53-097aa29dd08b with Priority: HIGHEST for action port [ 955.912129] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4cefab3-ab9a-4edc-bd53-097aa29dd08b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.912258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4cefab3-ab9a-4edc-bd53-097aa29dd08b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.912329] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4cefab3-ab9a-4edc-bd53-097aa29dd08b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.912588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4cefab3-ab9a-4edc-bd53-097aa29dd08b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.912903] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4cefab3-ab9a-4edc-bd53-097aa29dd08b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.415603] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4cefab3-ab9a-4edc-bd53-097aa29dd08b [ 956.415783] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.415920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.415920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.416186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.416316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.416464] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4cefab3-ab9a-4edc-bd53-097aa29dd08b already deleted. [ 956.416934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4cefab3-ab9a-4edc-bd53-097aa29dd08b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.853833] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 in Status: SUCCESS [ 956.854043] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 deletion is rescheduled due to dependency. [ 956.854164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.287716] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 957.288111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.508891] env[65087]: INFO networking_nsxv3.common.synchronization [req-3b901240-c71c-49c8-8536-88efdede5448 req-6a7fa562-e7d2-4dd0-93b2-94084eed79d8 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 959.510144] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 959.510144] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.510144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.510144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.510144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.510432] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.510432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.510432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.511060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.511060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.511060] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.824461] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.824461] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.824461] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.825014] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.825411] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.825909] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.825909] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.826195] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.826558] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.826558] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.826671] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.826764] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.826872] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.826981] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.827099] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.827291] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.849598] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.849777] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.849893] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.850086] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.850401] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-ed9ee29e-895d-4337-b3ea-3e189642bd78 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.851238] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-ed9ee29e-895d-4337-b3ea-3e189642bd78" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.851238] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-ed9ee29e-895d-4337-b3ea-3e189642bd78" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.851238] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-ed9ee29e-895d-4337-b3ea-3e189642bd78" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.851238] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed9ee29e-895d-4337-b3ea-3e189642bd78',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.012689] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.013111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.013111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.013219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.013297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.013498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.013642] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.013721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.013844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.013899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.013977] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 960.045420] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.045621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.045738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.045977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.046176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.056287] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 960.354457] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.354784] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.354976] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.355201] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.355359] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.355521] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port ed9ee29e-895d-4337-b3ea-3e189642bd78 not found, creating... [ 960.355803] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.355965] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.356100] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.356355] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.356474] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.356819] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.356912] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.357055] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.357270] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.357464] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.358397] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: ed9ee29e-895d-4337-b3ea-3e189642bd78 is going to be created. [ 960.381295] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.381514] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.381622] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.381996] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.382252] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.382481] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-ed9ee29e-895d-4337-b3ea-3e189642bd78" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.107929] env[65087]: INFO networking_nsxv3.common.synchronization [req-3b901240-c71c-49c8-8536-88efdede5448 req-17b3fe8f-6818-4124-a8f7-629663a37ccc service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 961.108185] env[65087]: INFO networking_nsxv3.common.synchronization [req-3b901240-c71c-49c8-8536-88efdede5448 req-17b3fe8f-6818-4124-a8f7-629663a37ccc service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 961.108279] env[65087]: INFO networking_nsxv3.common.synchronization [req-3b901240-c71c-49c8-8536-88efdede5448 req-17b3fe8f-6818-4124-a8f7-629663a37ccc service nova] Enqueued Resource ID: ed9ee29e-895d-4337-b3ea-3e189642bd78 with Priority: HIGHEST for action port [ 961.108821] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 961.108975] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 961.109099] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed9ee29e-895d-4337-b3ea-3e189642bd78 with Priority: HIGHEST for action port [ 961.109399] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.109536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.109609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.109820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.109912] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.110839] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.111816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.111816] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed9ee29e-895d-4337-b3ea-3e189642bd78 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.111816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed9ee29e-895d-4337-b3ea-3e189642bd78" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.111816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed9ee29e-895d-4337-b3ea-3e189642bd78" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.111816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed9ee29e-895d-4337-b3ea-3e189642bd78" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.111816] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed9ee29e-895d-4337-b3ea-3e189642bd78',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.613752] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.613974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.614136] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed9ee29e-895d-4337-b3ea-3e189642bd78 with status ACTIVE [ 961.614267] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.614422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.614622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.614855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.614954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.615145] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.615306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.615344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.615497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.615577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.615765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.615858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.615917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.617221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.617221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.617221] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed9ee29e-895d-4337-b3ea-3e189642bd78 is going to be updated. [ 961.644520] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.644672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.644768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.644961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.645138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.645333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed9ee29e-895d-4337-b3ea-3e189642bd78" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.034476] env[65087]: INFO networking_nsxv3.common.synchronization [req-9fc94898-1093-410e-bed8-1893ed5df901 req-c9f26e7a-eca2-4072-a31a-c77a48be50a9 tempest-ServerAddressesTestJSON-1185583607 tempest-ServerAddressesTestJSON-1185583607-project-member] Enqueued Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGHEST for action security_group_members [ 962.034640] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGHEST for action security_group_members [ 962.034939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-3291e19b-f819-4f27-bac2-5fd32a181ddc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.035102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.035163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.035516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.035980] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.035980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.035980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.035980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.037226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.037226] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.067678] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 962.067678] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 962.067678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.068275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.068494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.068681] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.069757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.069757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.069757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.069757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.069757] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.270974] env[65087]: INFO networking_nsxv3.common.synchronization [req-e7a32819-1bf9-4a49-b16c-893879d093af req-e3566353-3188-4be5-9c57-7ffc10be9056 tempest-ListServerFiltersTestJSON-16229912 tempest-ListServerFiltersTestJSON-16229912-project-member] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 962.271576] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 962.271905] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.272292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.272447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.272947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.273266] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.273372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.273629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.273967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.274139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.274321] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.435912] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-857 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.436245] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-857" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.436401] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-857" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.436744] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-857" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.437015] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.437195] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.437316] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.437580] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.437744] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.437952] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.438078] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.438183] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.438289] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.438401] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.438488] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.438619] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.457610] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.457833] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.457920] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.458125] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-857" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.458451] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-0a6937fb-0484-4051-af2e-828166804dd0 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.458642] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-0a6937fb-0484-4051-af2e-828166804dd0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.458763] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-0a6937fb-0484-4051-af2e-828166804dd0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.459129] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-0a6937fb-0484-4051-af2e-828166804dd0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.459276] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6937fb-0484-4051-af2e-828166804dd0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.538355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.538534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.538612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.538780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.538964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.539078] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.539180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.539243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.539402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.539481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.539563] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc already deleted. [ 962.539641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.571197] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.777188] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.962059] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.962304] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.962410] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.962726] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.962892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.963063] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 0a6937fb-0484-4051-af2e-828166804dd0 not found, creating... [ 962.963400] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.963572] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.963704] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.963952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.964117] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.964421] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.964593] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.964708] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.964935] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.965091] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.965269] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 0a6937fb-0484-4051-af2e-828166804dd0 is going to be created. [ 962.987104] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.987336] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.987454] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.987730] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.988012] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.988210] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-0a6937fb-0484-4051-af2e-828166804dd0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.073439] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.279948] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.575616] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.575968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.576051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.576251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.576362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.576499] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 963.609436] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.609637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.609748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.610050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.610265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.621376] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 963.734414] env[65087]: INFO networking_nsxv3.common.synchronization [req-9fc94898-1093-410e-bed8-1893ed5df901 req-222b6e2e-b1b3-4714-af2e-f79ffc4cc5e1 service nova] Enqueued Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGHEST for action security_group_rules [ 963.734618] env[65087]: INFO networking_nsxv3.common.synchronization [req-9fc94898-1093-410e-bed8-1893ed5df901 req-222b6e2e-b1b3-4714-af2e-f79ffc4cc5e1 service nova] Enqueued Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGHEST for action security_group_members [ 963.734756] env[65087]: INFO networking_nsxv3.common.synchronization [req-9fc94898-1093-410e-bed8-1893ed5df901 req-222b6e2e-b1b3-4714-af2e-f79ffc4cc5e1 service nova] Enqueued Resource ID: 0a6937fb-0484-4051-af2e-828166804dd0 with Priority: HIGHEST for action port [ 963.735623] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGHEST for action security_group_rules [ 963.735623] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGHEST for action security_group_members [ 963.735781] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a6937fb-0484-4051-af2e-828166804dd0 with Priority: HIGHEST for action port [ 963.735977] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3291e19b-f819-4f27-bac2-5fd32a181ddc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.736502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.736617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.736932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.737075] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.739199] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-3291e19b-f819-4f27-bac2-5fd32a181ddc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.739303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.739398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.739628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.739995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.740150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.740238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.740436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.740774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.740774] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.741783] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a6937fb-0484-4051-af2e-828166804dd0 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.742234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a6937fb-0484-4051-af2e-828166804dd0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.742750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a6937fb-0484-4051-af2e-828166804dd0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.742913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a6937fb-0484-4051-af2e-828166804dd0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.743198] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6937fb-0484-4051-af2e-828166804dd0',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.782831] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.782831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.783071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.784997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.784997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.784997] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 963.826036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.827210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.827359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.827605] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.828312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.845311] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 964.239644] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-3291e19b-f819-4f27-bac2-5fd32a181ddc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.239771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.245285] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a6937fb-0484-4051-af2e-828166804dd0 with status ACTIVE [ 964.245528] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.245668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.245761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.246045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.246165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.246369] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.246530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.246634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.246982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.247231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.247520] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.247658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.247731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.247888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.248008] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.248155] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a6937fb-0484-4051-af2e-828166804dd0 is going to be updated. [ 964.249542] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.287238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.287630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.287630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.287868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.288081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.288336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a6937fb-0484-4051-af2e-828166804dd0" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.755604] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.258904] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.259249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.259249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.259846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.259846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.260116] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc is going to be created. [ 965.292689] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.293284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.293284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.293284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.293554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.312873] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc in Status: UNINITIALIZED for 2s [ 965.632321] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 965.632550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.632722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.633020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.633169] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.633290] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.633351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.633490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.633715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.633715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.633822] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.856649] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 965.856864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.136327] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.136597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.136597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.136786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.136956] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.137093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.137148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.137288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.137375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.137462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.137653] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.137788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.137788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.137920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.138063] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.138151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.138211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.138393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.138506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.138613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.138729] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.643081] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e5af08c-4029-463c-937e-2ea7bf68d7d1: rpc.has_security_group_logging(os_id): False [ 966.660666] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.660852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.660889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.661164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.661274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.661504] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.661604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.661668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.661827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.662679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.662679] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.662679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.662679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.662679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.662679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.662679] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.662992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.662992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.662992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.663213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.663357] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 966.729402] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.729604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.729674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.729855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.729976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.746743] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 967.324071] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc in Status: SUCCESS [ 967.324334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.324539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.324782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.325072] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.325213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.325213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.325444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.325545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.325631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.325743] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.828339] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-3291e19b-f819-4f27-bac2-5fd32a181ddc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.828650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.828650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.828854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.829056] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.829180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.829252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.829441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.829535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.829641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.829799] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-3291e19b-f819-4f27-bac2-5fd32a181ddc taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.829910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.830111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.830166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.830305] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.830411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.830473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.830643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.830721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.830819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.830926] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.335244] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3291e19b-f819-4f27-bac2-5fd32a181ddc: rpc.has_security_group_logging(os_id): False [ 968.354340] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.354527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.354592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.355049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.355142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.355349] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.355498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.355560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.355685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.355758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.355960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.356042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.356119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.356383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.356383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.356521] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.356619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.356682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.356824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.356898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.356985] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc is going to be created. [ 968.425848] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.426122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.426122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.426482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.426788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.439200] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc in Status: IN_PROGRESS for 2s [ 968.623036] env[65087]: INFO networking_nsxv3.common.synchronization [req-1d26d0f6-667a-4917-a425-5284b970ed97 req-bde1800f-d7be-4d54-9164-0bbcd20e153e tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 968.623793] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 968.624182] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.624574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.624574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.624746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.624929] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.625043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.625117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.625499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.625499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.625595] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.764076] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 968.764335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.982819] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.983698] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.983977] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.984424] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.984838] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.985569] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.985569] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.985569] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.985987] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.985987] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.985987] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.986727] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.986727] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.986727] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.986727] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.986727] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.011222] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.011408] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.011550] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.011781] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.012204] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-f33d60f1-31b3-4581-946e-ec865a012e16 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.012423] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-f33d60f1-31b3-4581-946e-ec865a012e16" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.012581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-f33d60f1-31b3-4581-946e-ec865a012e16" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.012934] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-f33d60f1-31b3-4581-946e-ec865a012e16" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.013111] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f33d60f1-31b3-4581-946e-ec865a012e16',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.127765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.128281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.128401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.128688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.128812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.129100] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.129236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.129329] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.129542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.129640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.129757] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b already deleted. [ 969.129858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.515569] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.515867] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.516066] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.516447] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.516619] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.516813] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port f33d60f1-31b3-4581-946e-ec865a012e16 not found, creating... [ 969.517111] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.517281] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.517403] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.517643] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.517782] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.518083] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.518242] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.518356] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.518567] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.518700] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.518837] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: f33d60f1-31b3-4581-946e-ec865a012e16 is going to be created. [ 969.565064] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.565414] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.565573] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.565867] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.566173] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.566374] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-f33d60f1-31b3-4581-946e-ec865a012e16" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.313978] env[65087]: INFO networking_nsxv3.common.synchronization [req-1d26d0f6-667a-4917-a425-5284b970ed97 req-aa2cabef-a15d-4377-8242-530168369dc7 service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 970.315316] env[65087]: INFO networking_nsxv3.common.synchronization [req-1d26d0f6-667a-4917-a425-5284b970ed97 req-aa2cabef-a15d-4377-8242-530168369dc7 service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 970.315316] env[65087]: INFO networking_nsxv3.common.synchronization [req-1d26d0f6-667a-4917-a425-5284b970ed97 req-aa2cabef-a15d-4377-8242-530168369dc7 service nova] Enqueued Resource ID: f33d60f1-31b3-4581-946e-ec865a012e16 with Priority: HIGHEST for action port [ 970.315316] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 970.315316] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 970.315316] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33d60f1-31b3-4581-946e-ec865a012e16 with Priority: HIGHEST for action port [ 970.316621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.316814] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.316883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.318137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.321072] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.321934] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.322054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.322132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.323427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.323427] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.323427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.323427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.323427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.323427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.323427] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.324150] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f33d60f1-31b3-4581-946e-ec865a012e16 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.324494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f33d60f1-31b3-4581-946e-ec865a012e16" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.324494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f33d60f1-31b3-4581-946e-ec865a012e16" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.324564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f33d60f1-31b3-4581-946e-ec865a012e16" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.325107] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f33d60f1-31b3-4581-946e-ec865a012e16',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.453398] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc in Status: SUCCESS [ 970.453755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.826538] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.826637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.827194] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.829014] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f33d60f1-31b3-4581-946e-ec865a012e16 with status ACTIVE [ 970.829014] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.829014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.829014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.829014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.829014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.829014] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.829014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.829014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.829014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.829014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.829438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.829438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.829438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.829438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.829553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.829591] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f33d60f1-31b3-4581-946e-ec865a012e16 is going to be updated. [ 970.881724] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.881881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.881915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.882161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.882313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.882480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f33d60f1-31b3-4581-946e-ec865a012e16" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.033179] env[65087]: INFO networking_nsxv3.common.synchronization [req-7866c1dc-2477-46f9-957c-cb7b8ddac292 req-17421b17-d7d7-48bf-ba9b-7cd87c8a6873 tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_members [ 971.033179] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_members [ 971.033179] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.033179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.033179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.033179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.033179] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.033179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.033179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.033677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.033677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.033677] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.331259] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.509018] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.509018] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.509018] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.509018] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.509663] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.510029] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.513098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.513098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.513098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.513098] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.513098] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.513098] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.513098] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.513098] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.513098] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.513098] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.534652] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.534652] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.534652] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.535181] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.535723] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.536299] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.536299] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.537763] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.537763] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b685d7c7-fcf1-4e20-8344-79b8cb4b4c83',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.541333] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.541333] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.541333] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e already deleted. [ 971.541333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.834198] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.834409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.834460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.834682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.834773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.834877] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be created. [ 971.864822] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.865055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.865055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.865259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.865556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.877956] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: UNINITIALIZED for 2s [ 972.043022] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.043382] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.043581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.043957] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.044213] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.045081] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port b685d7c7-fcf1-4e20-8344-79b8cb4b4c83 not found, creating... [ 972.045081] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.045081] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.045260] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.045581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.045756] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.046177] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.046406] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.046566] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.046859] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.047061] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.047281] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: b685d7c7-fcf1-4e20-8344-79b8cb4b4c83 is going to be created. [ 972.076765] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.077027] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.077484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.077617] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.077985] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.078194] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.811046] env[65087]: INFO networking_nsxv3.common.synchronization [req-7866c1dc-2477-46f9-957c-cb7b8ddac292 req-5a544c6a-fa92-4871-bcde-99f67af67249 service nova] Enqueued Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_rules [ 972.811353] env[65087]: INFO networking_nsxv3.common.synchronization [req-7866c1dc-2477-46f9-957c-cb7b8ddac292 req-5a544c6a-fa92-4871-bcde-99f67af67249 service nova] Enqueued Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_members [ 972.811398] env[65087]: INFO networking_nsxv3.common.synchronization [req-7866c1dc-2477-46f9-957c-cb7b8ddac292 req-5a544c6a-fa92-4871-bcde-99f67af67249 service nova] Enqueued Resource ID: b685d7c7-fcf1-4e20-8344-79b8cb4b4c83 with Priority: HIGHEST for action port [ 972.811953] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_rules [ 972.812097] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_members [ 972.812198] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b685d7c7-fcf1-4e20-8344-79b8cb4b4c83 with Priority: HIGHEST for action port [ 972.812603] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.812603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.812707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.813209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.813209] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.813801] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.813931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.814191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.814191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.814374] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.814514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.814514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.814622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.814707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.814797] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.821550] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.821700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.821743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.821968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.822076] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b685d7c7-fcf1-4e20-8344-79b8cb4b4c83',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.324270] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.324476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.325973] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b685d7c7-fcf1-4e20-8344-79b8cb4b4c83 with status ACTIVE [ 973.326202] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.326699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.326699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.326699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.326862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.326924] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.327079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.327178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.327365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.327480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.327689] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.327816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.327885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.328078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.328160] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.328250] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b685d7c7-fcf1-4e20-8344-79b8cb4b4c83 is going to be updated. [ 973.329335] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.352939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.352939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.352939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.352939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.352939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.353259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b685d7c7-fcf1-4e20-8344-79b8cb4b4c83" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.413358] env[65087]: INFO networking_nsxv3.common.synchronization [req-be3c240b-908e-407a-8e3e-1c93cd4529af req-7f06f82c-17c9-46ba-91a6-cd6619ed9ebb tempest-ServerAddressesTestJSON-1185583607 tempest-ServerAddressesTestJSON-1185583607-project-member] Enqueued Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGHEST for action security_group_members [ 973.413930] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGHEST for action security_group_members [ 973.414261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-3291e19b-f819-4f27-bac2-5fd32a181ddc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.414401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.414482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.414947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.414947] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.414947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.415183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.415183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.415332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.415332] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.832261] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.890933] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 973.890933] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.890933] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.891355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.891756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.892051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.892051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.892226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.892380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.892514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.892663] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.917491] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.917663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.918724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.918724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.918724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.918724] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.918724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.918724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.918724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.918724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.918724] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc is going to be updated. [ 973.950809] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.950809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.950809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.950809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.950809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.961415] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc in Status: IN_PROGRESS for 2s [ 974.337695] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.337695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.337695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.337695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.337695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.337695] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e is going to be created. [ 974.370763] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.370763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.370763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.370763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.370763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.387752] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1379de6-944a-41ee-b7a5-1b4425bc546e in Status: UNINITIALIZED for 2s [ 974.395569] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.395774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.397196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.397503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.397706] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.397824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.397890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.398071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.398163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.398256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.398415] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.398507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.398574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.398714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.398853] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.398944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.399011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.399161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.399237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.399320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.399415] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.905515] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4986f406-ffa8-458b-a142-64bc589ad53b: rpc.has_security_group_logging(os_id): False [ 974.927470] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.927682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.927682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.927931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.928015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.928552] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.928552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.928552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.928552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.928802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.928802] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.928878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.928970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.929094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.929169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.929361] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.929462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.929519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.929679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.929729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.929796] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be created. [ 975.005060] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.005348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.005348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.005609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.005808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.019098] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 975.591061] env[65087]: INFO networking_nsxv3.common.synchronization [req-8390dfe1-86dc-4198-b8c1-2d8b52461dc3 req-e11cd0e3-e453-4b7a-8aa7-0c7d2c5341d4 tempest-DeleteServersAdminTestJSON-1251840204 tempest-DeleteServersAdminTestJSON-1251840204-project-member] Enqueued Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 975.594542] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 975.594542] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.594542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.594542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.594542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.594542] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.594542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.594542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.594542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.594542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.594542] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.971666] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc in Status: SUCCESS [ 975.971666] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc deletion is rescheduled due to dependency. [ 975.971666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.038479] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.038697] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.038855] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.039222] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.039505] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.039668] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.039783] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.040013] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.040183] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.040397] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.040511] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.040640] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.040720] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.040829] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.040933] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.041077] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.061184] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.061366] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.061521] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.061721] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-616" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.062057] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-e2730ed1-673a-4e7f-919d-e1b1a479b557 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.062239] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-e2730ed1-673a-4e7f-919d-e1b1a479b557" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.062383] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-e2730ed1-673a-4e7f-919d-e1b1a479b557" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.062752] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-e2730ed1-673a-4e7f-919d-e1b1a479b557" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.062869] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2730ed1-673a-4e7f-919d-e1b1a479b557',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.098727] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.098853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.098924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.099154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.099245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.099443] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.099557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.099603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.099755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.099862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.099977] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 is going to be updated. [ 976.131509] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.131721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.131816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.132047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.132202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.148754] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: IN_PROGRESS for 2s [ 976.400027] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1379de6-944a-41ee-b7a5-1b4425bc546e in Status: SUCCESS [ 976.400027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.400027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.400027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.400027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.400027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.400027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.400027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.400027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.400027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.400027] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.567085] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.567312] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.567439] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.567732] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.567887] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.568074] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port e2730ed1-673a-4e7f-919d-e1b1a479b557 not found, creating... [ 976.568335] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.568505] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.568604] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.569017] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.569017] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.569279] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.569430] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.569602] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.571450] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.571450] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.571450] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: e2730ed1-673a-4e7f-919d-e1b1a479b557 is going to be created. [ 976.610458] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.610458] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.610861] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.610918] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.611260] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.611518] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-e2730ed1-673a-4e7f-919d-e1b1a479b557" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.903114] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.032455] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 977.032773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.406647] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1379de6-944a-41ee-b7a5-1b4425bc546e: rpc.has_security_group_logging(os_id): False [ 977.419071] env[65087]: INFO networking_nsxv3.common.synchronization [req-8390dfe1-86dc-4198-b8c1-2d8b52461dc3 req-25cedaf2-8b42-4d34-9e6b-4d3a88d8b8bb service nova] Enqueued Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_rules [ 977.419399] env[65087]: INFO networking_nsxv3.common.synchronization [req-8390dfe1-86dc-4198-b8c1-2d8b52461dc3 req-25cedaf2-8b42-4d34-9e6b-4d3a88d8b8bb service nova] Enqueued Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 977.419533] env[65087]: INFO networking_nsxv3.common.synchronization [req-8390dfe1-86dc-4198-b8c1-2d8b52461dc3 req-25cedaf2-8b42-4d34-9e6b-4d3a88d8b8bb service nova] Enqueued Resource ID: e2730ed1-673a-4e7f-919d-e1b1a479b557 with Priority: HIGHEST for action port [ 977.420214] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_rules [ 977.420360] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 977.420445] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2730ed1-673a-4e7f-919d-e1b1a479b557 with Priority: HIGHEST for action port [ 977.420800] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.420944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.421026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.421269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.421370] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.422540] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.422648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.422896] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2730ed1-673a-4e7f-919d-e1b1a479b557 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.423057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2730ed1-673a-4e7f-919d-e1b1a479b557" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.423182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2730ed1-673a-4e7f-919d-e1b1a479b557" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.423653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2730ed1-673a-4e7f-919d-e1b1a479b557" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.423653] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2730ed1-673a-4e7f-919d-e1b1a479b557',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.431015] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.431015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.431188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.431997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.431997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.431997] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.431997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.431997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.431997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.431997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.432312] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e is going to be created. [ 977.524793] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.524923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.524997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.525246] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.525510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.538576] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1379de6-944a-41ee-b7a5-1b4425bc546e in Status: IN_PROGRESS for 2s [ 977.925525] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.925685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.928217] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2730ed1-673a-4e7f-919d-e1b1a479b557 with status ACTIVE [ 977.928504] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.928692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.928775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.929024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.929124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.929315] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.929421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.929493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.929659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.929738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.929964] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.930081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.930147] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.930320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.930404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.930530] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2730ed1-673a-4e7f-919d-e1b1a479b557 is going to be updated. [ 977.954150] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.954335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.954397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.954648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.954807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.954976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2730ed1-673a-4e7f-919d-e1b1a479b557" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.154119] env[65087]: INFO networking_nsxv3.common.synchronization [req-932ef3be-c65c-4bd5-95aa-d8ec01ad09bc req-263c29e8-1599-4d29-b57e-504d9c0ad82b tempest-ImagesOneServerNegativeTestJSON-1111695184 tempest-ImagesOneServerNegativeTestJSON-1111695184-project-member] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 978.155846] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 978.156142] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.156301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.156371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.156765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.156976] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.157104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.157169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.157345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.157434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.157535] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.165471] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: SUCCESS [ 978.165595] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 deletion is rescheduled due to dependency. [ 978.165901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.165901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.166850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.166850] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.166850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.166850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.166850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.166850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.167193] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.606223] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.606507] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.606738] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.607139] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.607421] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.607586] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.607706] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.607932] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.608096] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.608312] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.608445] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.608565] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.608671] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.608799] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.608905] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.609052] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.628843] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.629013] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.629185] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.629372] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.629800] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-f82cbb21-1c7b-4a70-b44e-de53dccd9980 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.630171] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-f82cbb21-1c7b-4a70-b44e-de53dccd9980" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.630406] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-f82cbb21-1c7b-4a70-b44e-de53dccd9980" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.630806] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-f82cbb21-1c7b-4a70-b44e-de53dccd9980" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.630975] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f82cbb21-1c7b-4a70-b44e-de53dccd9980',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.659954] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.660324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.660324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.660520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.660520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.660754] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.660905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.660905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.661051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.661173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.661264] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca already deleted. [ 978.661330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.671103] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.134227] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.134434] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.134566] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.134858] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.135037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.135217] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port f82cbb21-1c7b-4a70-b44e-de53dccd9980 not found, creating... [ 979.135549] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.135741] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.135877] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.136125] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.136293] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.136661] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.136839] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.136959] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.137322] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.137486] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.137632] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: f82cbb21-1c7b-4a70-b44e-de53dccd9980 is going to be created. [ 979.163035] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.163035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.163035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.163455] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.163758] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.164031] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-f82cbb21-1c7b-4a70-b44e-de53dccd9980" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.172068] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.552721] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1379de6-944a-41ee-b7a5-1b4425bc546e in Status: SUCCESS [ 979.552721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.675805] env[65087]: INFO networking_nsxv3.common.synchronization [req-5d720632-bbf8-4414-839f-e6b47dde9197 req-d608b634-1cfa-4dad-8faa-a51e2bc4ed5a tempest-ServersNegativeTestJSON-734531957 tempest-ServersNegativeTestJSON-734531957-project-member] Enqueued Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 979.676236] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.676393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.676493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.676702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.676795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.676899] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 is going to be updated. [ 979.678312] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 with Priority: HIGHEST for action security_group_members [ 979.678618] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa843f83-ade7-475f-9e86-d1f12b4e1f38 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.678782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.678782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.678956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.679125] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.679217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.679276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.679414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.679497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.679588] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa843f83-ade7-475f-9e86-d1f12b4e1f38',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.710775] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.710990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.711059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.711247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.711400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.724159] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: IN_PROGRESS for 2s [ 979.885257] env[65087]: INFO networking_nsxv3.common.synchronization [req-932ef3be-c65c-4bd5-95aa-d8ec01ad09bc req-0638bd86-c5b5-4cde-abe0-bfb2d72a93e1 service nova] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_rules [ 979.885514] env[65087]: INFO networking_nsxv3.common.synchronization [req-932ef3be-c65c-4bd5-95aa-d8ec01ad09bc req-0638bd86-c5b5-4cde-abe0-bfb2d72a93e1 service nova] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 979.885612] env[65087]: INFO networking_nsxv3.common.synchronization [req-932ef3be-c65c-4bd5-95aa-d8ec01ad09bc req-0638bd86-c5b5-4cde-abe0-bfb2d72a93e1 service nova] Enqueued Resource ID: f82cbb21-1c7b-4a70-b44e-de53dccd9980 with Priority: HIGHEST for action port [ 979.886444] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_rules [ 979.886596] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 979.886698] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f82cbb21-1c7b-4a70-b44e-de53dccd9980 with Priority: HIGHEST for action port [ 979.886987] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.887217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.888249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.888249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.888249] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.890639] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.890639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.890725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.890971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.891362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.891362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.891594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.891784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.892088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.892088] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.893776] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f82cbb21-1c7b-4a70-b44e-de53dccd9980 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.893941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f82cbb21-1c7b-4a70-b44e-de53dccd9980" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.893941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f82cbb21-1c7b-4a70-b44e-de53dccd9980" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.894126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f82cbb21-1c7b-4a70-b44e-de53dccd9980" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.894209] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f82cbb21-1c7b-4a70-b44e-de53dccd9980',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.185193] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.185193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.185193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.185193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.185193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.185193] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.185193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.185193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.185193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.185193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.185193] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 is going to be updated. [ 980.222405] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.222405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.222405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.222405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.222405] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.232087] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: IN_PROGRESS for 2s [ 980.395398] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.396790] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.396992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.397160] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f82cbb21-1c7b-4a70-b44e-de53dccd9980 with status ACTIVE [ 980.397324] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.397661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.397661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.397833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.397960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.399257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.399432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.399490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.399694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.400099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.406493] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.406626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.406626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.406817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.406905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.407019] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f82cbb21-1c7b-4a70-b44e-de53dccd9980 is going to be updated. [ 980.435440] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.435961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.435961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.435961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.436315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.436315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f82cbb21-1c7b-4a70-b44e-de53dccd9980" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.912202] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.414505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.414877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.414877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.415556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.415556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.415556] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be created. [ 981.445753] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.445753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.445753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.445753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.445753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.459693] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: UNINITIALIZED for 2s [ 981.735491] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: SUCCESS [ 981.735782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.735994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.736263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.736503] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.736657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.736730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.736907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.737023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.737114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.737231] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.239774] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.239945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.240056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.240324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.240493] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.240607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.240672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.240847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.240946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.241513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.241513] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.241513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.241513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.241810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.241810] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.241810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.241980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.242039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.242101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.242205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.242336] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.246792] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 in Status: SUCCESS [ 982.246939] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa843f83-ade7-475f-9e86-d1f12b4e1f38 deletion is rescheduled due to dependency. [ 982.247043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa843f83-ade7-475f-9e86-d1f12b4e1f38" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.488131] env[65087]: INFO networking_nsxv3.common.synchronization [req-976c9276-14fe-4bcb-8f01-889e91676617 req-a4679ecf-2530-48d6-9a82-7c668fe08c5f tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 982.488688] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 982.489022] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.491682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.491847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.492123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.492252] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.492362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.492435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.492587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.492673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.492772] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.744957] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d58a5975-db0d-4e76-84b4-0eaa1b1c8688: rpc.has_security_group_logging(os_id): False [ 982.765028] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.765257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.765345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.765678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.765897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.766099] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.766245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.766395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.766553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.766639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.766838] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.766937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.767009] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.767143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.767213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.767394] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.767953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.767953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.767953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.767953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.767953] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 is going to be updated. [ 982.839242] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.839874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.839946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.840426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.840426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.888716] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: IN_PROGRESS for 2s [ 982.995458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.995644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.995703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.995922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.996033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.996253] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.996363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.996425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.996597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.996684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.996777] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 983.031658] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.031855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.031915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.032239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.032404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.042646] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 983.472045] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 983.472045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.472045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.472045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.472045] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.472432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.472432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.472507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.472575] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.472661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.472753] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.976273] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.976273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.976273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.976273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.976273] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.977358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.977467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.978446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.978446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.978446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.978446] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.978446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.978446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.978446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.978446] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.978940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.978940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.978940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.978940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.978940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.978940] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.481294] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 336c99cf-6401-42f0-a311-bcd662eef8ca: rpc.has_security_group_logging(os_id): False [ 984.499836] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.499996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.500145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.500307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.500370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.500590] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.500685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.500765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.501374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.501374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.501691] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.501691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.501691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.501943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.502276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.502476] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.502577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.502640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.502783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.502860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.502947] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be created. [ 984.572549] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.572763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.572841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.573074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.573346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.590520] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: IN_PROGRESS for 2s [ 984.631958] env[65087]: INFO networking_nsxv3.common.synchronization [None req-aaf955ee-7a95-4fe0-aa66-ffe8398f094e None None] Enqueued Resource ID: 84d29476-b746-4025-9520-42506c4dc154 with Priority: HIGHEST for action port [ 984.633689] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84d29476-b746-4025-9520-42506c4dc154 with Priority: HIGHEST for action port [ 984.634202] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-84d29476-b746-4025-9520-42506c4dc154 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.634512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84d29476-b746-4025-9520-42506c4dc154" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.634512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84d29476-b746-4025-9520-42506c4dc154" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.634924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84d29476-b746-4025-9520-42506c4dc154" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.634924] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84d29476-b746-4025-9520-42506c4dc154',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.902512] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: SUCCESS [ 984.902802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.053465] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 985.053465] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 985.053465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.137425] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84d29476-b746-4025-9520-42506c4dc154 [ 985.137425] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.137607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.137607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.137730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.138113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.138113] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84d29476-b746-4025-9520-42506c4dc154 already deleted. [ 985.138113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84d29476-b746-4025-9520-42506c4dc154" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.396776] env[65087]: INFO networking_nsxv3.common.synchronization [req-4201f063-5dd6-4864-84d9-06faebe05a6d req-4e744044-366b-4f46-8b10-2a502e403345 tempest-ListServerFiltersTestJSON-16229912 tempest-ListServerFiltersTestJSON-16229912-project-member] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 985.399069] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 985.399069] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.399272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.399344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.399600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.399858] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.400051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.400124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.400357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.400457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.400555] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.903618] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.406614] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.614280] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 986.614500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.908528] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.908800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.908800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.908972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.909079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.909187] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 986.929021] env[65087]: INFO networking_nsxv3.common.synchronization [None req-fa258047-eff5-425b-91e1-ef55cb3e93bc None None] Enqueued Resource ID: 60807acf-76c9-4eba-8bba-3340ac37146f with Priority: HIGHEST for action port [ 986.929021] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60807acf-76c9-4eba-8bba-3340ac37146f with Priority: HIGHEST for action port [ 986.929579] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-60807acf-76c9-4eba-8bba-3340ac37146f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.929924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60807acf-76c9-4eba-8bba-3340ac37146f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.930103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60807acf-76c9-4eba-8bba-3340ac37146f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.930438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60807acf-76c9-4eba-8bba-3340ac37146f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.930610] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60807acf-76c9-4eba-8bba-3340ac37146f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.953380] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.953380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.953639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.953679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.953831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.967358] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 987.432976] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60807acf-76c9-4eba-8bba-3340ac37146f [ 987.433274] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.433529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.433651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.434543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.434667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.434802] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60807acf-76c9-4eba-8bba-3340ac37146f already deleted. [ 987.434941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60807acf-76c9-4eba-8bba-3340ac37146f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.978388] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 988.978692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.401175] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c91ed63-50ec-4c8d-8739-7933d4177411 req-fdfcc5f9-e7fe-42fe-b017-bd0df2afdc5e tempest-DeleteServersAdminTestJSON-1251840204 tempest-DeleteServersAdminTestJSON-1251840204-project-member] Enqueued Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 991.401774] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 with Priority: HIGHEST for action security_group_members [ 991.402114] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.402242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.402311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.402508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.402670] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.402769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.402832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.402981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.403087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.403180] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d58a5975-db0d-4e76-84b4-0eaa1b1c8688',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.905757] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.905928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.905972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.906220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.906325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.906555] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.906667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.906732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.906893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.906970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.907070] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 is going to be updated. [ 991.938565] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.938887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.938887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.939300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.939300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.950536] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: IN_PROGRESS for 2s [ 993.104033] env[65087]: INFO networking_nsxv3.common.synchronization [req-da6a734a-44ad-472c-b459-5b17bfefb556 req-a6fae624-a49d-40a4-a8b2-b807126298a7 tempest-ListServerFiltersTestJSON-16229912 tempest-ListServerFiltersTestJSON-16229912-project-member] Enqueued Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 993.105507] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc with Priority: HIGHEST for action security_group_members [ 993.105507] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.105507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.105507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.105507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.105765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.105858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.105921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.106145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.106211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.106311] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.608878] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.609053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.609128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.609343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.609439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.609635] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.609735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.609795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.609945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.610032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.610121] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc is going to be updated. [ 993.650181] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.650181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.650181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.650181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.650181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.661936] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: IN_PROGRESS for 2s [ 993.967662] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 in Status: SUCCESS [ 993.968598] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d58a5975-db0d-4e76-84b4-0eaa1b1c8688 deletion is rescheduled due to dependency. [ 993.968598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d58a5975-db0d-4e76-84b4-0eaa1b1c8688" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.265873] env[65087]: INFO networking_nsxv3.common.synchronization [req-77f6a055-ba31-422a-a217-acb79fab07af req-56cf52ce-e534-4052-bba0-a2492f1af2a3 tempest-ServerGroupTestJSON-419703568 tempest-ServerGroupTestJSON-419703568-project-member] Enqueued Resource ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e with Priority: HIGHEST for action security_group_members [ 994.266612] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e with Priority: HIGHEST for action security_group_members [ 994.267392] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1371be0-e403-4fc8-b7ba-48edcbdada5e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.267392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.267392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.267803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.267803] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.267803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.267942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.268038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.268125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.268219] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1371be0-e403-4fc8-b7ba-48edcbdada5e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.638712] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.638923] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-511" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.639425] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-511" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.639967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-511" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.640267] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.640433] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.640572] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.640799] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.640941] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.641163] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.641273] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.641376] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.641480] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.641639] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.641785] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.641919] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.661737] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.661995] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.662180] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.662374] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-511" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.662733] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.662915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.663046] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.663398] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.663619] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16dfcba1-0f8e-4dec-b97d-edfa7dce8755',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.771429] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.771666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.771666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.771882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.771977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.772201] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.772304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.772364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.772530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.772608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.772693] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e already deleted. [ 994.772772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.166118] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.166487] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.166730] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.167177] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.167445] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.167730] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 16dfcba1-0f8e-4dec-b97d-edfa7dce8755 not found, creating... [ 995.168199] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.168478] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.168708] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.169113] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.169355] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.169870] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.170161] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.170354] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.170681] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.170894] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.171105] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 16dfcba1-0f8e-4dec-b97d-edfa7dce8755 is going to be created. [ 995.199328] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.199702] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.199908] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.200319] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.200692] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.200992] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.672576] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc in Status: SUCCESS [ 995.672929] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc deletion is rescheduled due to dependency. [ 995.672929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.804553] env[65087]: INFO networking_nsxv3.common.synchronization [req-4befaabf-9f00-4da4-8adb-4cf742562830 req-bf387197-95e0-423a-9c98-f34a07b6a7a5 tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 995.805278] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 995.805649] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.805778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.805848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.806077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.806312] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.806403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.806451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.806602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.806714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.806757] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.926206] env[65087]: INFO networking_nsxv3.common.synchronization [req-77f6a055-ba31-422a-a217-acb79fab07af req-42c48513-f376-4d51-8d14-b8b39d2ae951 service nova] Enqueued Resource ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e with Priority: HIGHEST for action security_group_rules [ 995.926411] env[65087]: INFO networking_nsxv3.common.synchronization [req-77f6a055-ba31-422a-a217-acb79fab07af req-42c48513-f376-4d51-8d14-b8b39d2ae951 service nova] Enqueued Resource ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e with Priority: HIGHEST for action security_group_members [ 995.926574] env[65087]: INFO networking_nsxv3.common.synchronization [req-77f6a055-ba31-422a-a217-acb79fab07af req-42c48513-f376-4d51-8d14-b8b39d2ae951 service nova] Enqueued Resource ID: 16dfcba1-0f8e-4dec-b97d-edfa7dce8755 with Priority: HIGHEST for action port [ 995.929220] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e with Priority: HIGHEST for action security_group_rules [ 995.929220] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e with Priority: HIGHEST for action security_group_members [ 995.933106] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16dfcba1-0f8e-4dec-b97d-edfa7dce8755 with Priority: HIGHEST for action port [ 995.933953] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c1371be0-e403-4fc8-b7ba-48edcbdada5e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.934161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.934235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.935129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.935129] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c1371be0-e403-4fc8-b7ba-48edcbdada5e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.936057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1371be0-e403-4fc8-b7ba-48edcbdada5e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.936232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.936302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.936494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.936702] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.936828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.936901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.937118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.937237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.937343] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1371be0-e403-4fc8-b7ba-48edcbdada5e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.938414] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.938561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.938628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.938777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.938873] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16dfcba1-0f8e-4dec-b97d-edfa7dce8755',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.258586] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.259206] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.259385] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.259688] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.259978] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.260152] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.260266] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.260484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.260632] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.260841] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.260951] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.261068] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.261174] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.261280] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.261383] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.261512] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.302097] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.302301] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.302436] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.302613] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.302986] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.303225] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.303337] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.303725] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.303884] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8179044a-7f4b-4c5f-9dfe-c45e33db2fb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.309633] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.309761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.309847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.310064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.310154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.310369] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.310474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.310584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.310704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.310781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.310883] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 996.343742] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.344045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.344182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.344533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.344787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.355822] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 996.442503] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1371be0-e403-4fc8-b7ba-48edcbdada5e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.442649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.445146] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c1371be0-e403-4fc8-b7ba-48edcbdada5e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.447498] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16dfcba1-0f8e-4dec-b97d-edfa7dce8755 with status ACTIVE [ 996.447498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.447498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.447498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.447498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.447498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.447498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.447498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.447498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.447498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.447498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.448225] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.448225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.448225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.448225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.448225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.448225] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16dfcba1-0f8e-4dec-b97d-edfa7dce8755 is going to be updated. [ 996.469950] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.470148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.470198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.470469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.470617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.470793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16dfcba1-0f8e-4dec-b97d-edfa7dce8755" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.806641] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.807115] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.807115] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.807491] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.807691] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.807950] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 8179044a-7f4b-4c5f-9dfe-c45e33db2fb6 not found, creating... [ 996.808302] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.808729] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.808729] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.808972] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.809185] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.809519] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.809725] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.809908] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.810188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.810383] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.810595] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 8179044a-7f4b-4c5f-9dfe-c45e33db2fb6 is going to be created. [ 996.847754] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.848075] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.848233] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.848519] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.848775] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.848995] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.950019] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c1371be0-e403-4fc8-b7ba-48edcbdada5e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.452592] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.452757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.452831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.453081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.453202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.453329] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e is going to be created. [ 997.480479] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.480640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.480684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.480875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.481101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.492979] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e in Status: UNINITIALIZED for 2s [ 997.584092] env[65087]: INFO networking_nsxv3.common.synchronization [req-4befaabf-9f00-4da4-8adb-4cf742562830 req-3967cb06-a11e-4701-afd3-e036c3affd61 service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 997.584287] env[65087]: INFO networking_nsxv3.common.synchronization [req-4befaabf-9f00-4da4-8adb-4cf742562830 req-3967cb06-a11e-4701-afd3-e036c3affd61 service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 997.584428] env[65087]: INFO networking_nsxv3.common.synchronization [req-4befaabf-9f00-4da4-8adb-4cf742562830 req-3967cb06-a11e-4701-afd3-e036c3affd61 service nova] Enqueued Resource ID: 8179044a-7f4b-4c5f-9dfe-c45e33db2fb6 with Priority: HIGHEST for action port [ 997.584957] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 997.585106] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 997.585205] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8179044a-7f4b-4c5f-9dfe-c45e33db2fb6 with Priority: HIGHEST for action port [ 997.585518] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.585790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.585790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.585898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.585983] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.586933] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.587041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.588716] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.588716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.588716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.588716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.588716] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8179044a-7f4b-4c5f-9dfe-c45e33db2fb6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.090140] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.090612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.090612] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8179044a-7f4b-4c5f-9dfe-c45e33db2fb6 with status ACTIVE [ 998.090881] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.091157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.091251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.091628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.091842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.091906] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.092070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.092180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.092432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.092593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.093027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.093270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.093445] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.093613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.093694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.093879] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8179044a-7f4b-4c5f-9dfe-c45e33db2fb6 is going to be updated. [ 998.120064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.120064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.120064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.120356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.120391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.120579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8179044a-7f4b-4c5f-9dfe-c45e33db2fb6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.373930] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 998.374153] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 998.374275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.374456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.374669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.374864] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.375456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.375456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.375456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.375456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.375456] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.879380] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.381220] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.504116] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e in Status: SUCCESS [ 999.504345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.504511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.504726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.504917] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.505044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.505112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.505261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.505339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.505424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.505590] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c1371be0-e403-4fc8-b7ba-48edcbdada5e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.883709] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.883996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.884144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.884684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.884937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.885030] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 999.920299] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.920299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.920299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.920299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.920299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.934596] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1000.008554] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1371be0-e403-4fc8-b7ba-48edcbdada5e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.008919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.008919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.009104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.009266] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.009384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.009465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.009635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.009743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.009844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.010024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1371be0-e403-4fc8-b7ba-48edcbdada5e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.010145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.010216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.010357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.010507] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.010631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.010734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.010906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.010974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.011063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.011187] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c1371be0-e403-4fc8-b7ba-48edcbdada5e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.513384] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c1371be0-e403-4fc8-b7ba-48edcbdada5e: rpc.has_security_group_logging(os_id): False [ 1000.536627] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.536627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.536750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.538850] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.538850] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.538850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.538850] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.539475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.539475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.539475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.539475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.539475] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e is going to be created. [ 1000.608276] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.608419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.608493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.608856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.609065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.623120] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e in Status: IN_PROGRESS for 2s [ 1001.554349] env[65087]: INFO networking_nsxv3.common.synchronization [req-5ad36577-f083-4e77-a06e-67da4416cad6 req-c102ecd9-9061-4b20-8da3-25a43e8b5360 tempest-ImagesOneServerNegativeTestJSON-1111695184 tempest-ImagesOneServerNegativeTestJSON-1111695184-project-member] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1001.555016] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1001.555367] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.555493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.555720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.556395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.556750] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.557013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.557150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.557816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.557816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.557816] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.946119] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1001.946424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.946569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.946778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.946975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.947108] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.947270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.947339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.947399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.947493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.947626] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.061055] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.061055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.061055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.061055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.061298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.061298] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.061383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.061430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.061627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.061710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.061801] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be updated. [ 1002.100059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.100059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.100059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.100324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.100324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.110817] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: IN_PROGRESS for 2s [ 1002.452621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.452621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.452621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.452621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.452621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.453278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.453278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.453278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.453278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.453278] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.648192] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e in Status: SUCCESS [ 1002.648192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.955779] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4986f406-ffa8-458b-a142-64bc589ad53b: rpc.has_security_group_logging(os_id): False [ 1002.975155] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.975343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.975382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.976154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.976321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.977281] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.977464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.977562] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.977830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.977981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.978280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.978413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.978491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.978714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.978826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.979069] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.979224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.979323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.979516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.979639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.979743] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1003.000356] env[65087]: INFO networking_nsxv3.common.synchronization [req-f89c06bd-07d9-441b-b1a1-540f60fa7339 req-e8f98a07-9b8f-44e5-8aa8-d6ba5a863eb7 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_members [ 1003.001115] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 with Priority: HIGHEST for action security_group_members [ 1003.001405] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d415299-ca3d-4305-942b-69b3b58ccb49 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.001715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.001715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.001868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.002063] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.002180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.002247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.002444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.002553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.002701] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d415299-ca3d-4305-942b-69b3b58ccb49',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.070820] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.071394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.073321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.073321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.073321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.089174] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1003.505065] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.505233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.505923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.506377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.507135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.507135] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.507290] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.507704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.507704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.507704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.507902] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 is going to be updated. [ 1003.542019] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.542250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.542250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.542477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.542865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.666014] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 in Status: IN_PROGRESS for 2s [ 1003.801953] env[65087]: INFO networking_nsxv3.common.synchronization [req-489be362-d446-43c1-ace2-5a5fbe4f1f27 req-f5ad1e1a-9d1c-4591-a0f5-43e61a42b530 tempest-ServersTestManualDisk-848731207 tempest-ServersTestManualDisk-848731207-project-member] Enqueued Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_members [ 1003.801953] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGHEST for action security_group_members [ 1003.801953] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5dac161d-87bb-4f31-a632-3c3213ca7adf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.802564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.805033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.805033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.805033] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.805033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.805033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.805033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.805033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.805033] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.121842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 1004.122050] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca deletion is rescheduled due to dependency. [ 1004.122174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.306061] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.306238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.306314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.306629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.307095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.307095] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.307095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.307248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.307302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.307352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.307465] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf is going to be updated. [ 1004.343733] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.343891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.343953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.344252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.344409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.354778] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf in Status: IN_PROGRESS for 2s [ 1005.105665] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1005.107027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.679668] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 in Status: SUCCESS [ 1005.679668] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d415299-ca3d-4305-942b-69b3b58ccb49 deletion is rescheduled due to dependency. [ 1005.679668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d415299-ca3d-4305-942b-69b3b58ccb49" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.073866] env[65087]: INFO networking_nsxv3.common.synchronization [None req-61bc58ad-7799-457d-99d3-cd03ba13272b None None] Enqueued Resource ID: 0bf95a9e-d73d-4771-beac-1837ae6eab2f with Priority: HIGHEST for action port [ 1006.073866] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bf95a9e-d73d-4771-beac-1837ae6eab2f with Priority: HIGHEST for action port [ 1006.074029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bf95a9e-d73d-4771-beac-1837ae6eab2f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.074284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bf95a9e-d73d-4771-beac-1837ae6eab2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.074284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bf95a9e-d73d-4771-beac-1837ae6eab2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.074515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bf95a9e-d73d-4771-beac-1837ae6eab2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.074835] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf95a9e-d73d-4771-beac-1837ae6eab2f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.369138] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf in Status: SUCCESS [ 1006.369987] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf deletion is rescheduled due to dependency. [ 1006.371262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.579206] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bf95a9e-d73d-4771-beac-1837ae6eab2f [ 1006.579206] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.579206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.579206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.579206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.579206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.579206] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bf95a9e-d73d-4771-beac-1837ae6eab2f already deleted. [ 1006.579206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bf95a9e-d73d-4771-beac-1837ae6eab2f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.726602] env[65087]: INFO networking_nsxv3.common.synchronization [None req-695c6da0-79b8-4af9-a110-9b573d4cfa7b tempest-ImagesOneServerNegativeTestJSON-1111695184 tempest-ImagesOneServerNegativeTestJSON-1111695184-project-member] Enqueued Resource ID: 8c853614-cf71-4ed4-a704-a633357d886d with Priority: HIGHEST for action security_group_rules [ 1006.727277] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c853614-cf71-4ed4-a704-a633357d886d with Priority: HIGHEST for action security_group_rules [ 1006.727633] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c853614-cf71-4ed4-a704-a633357d886d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.727752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c853614-cf71-4ed4-a704-a633357d886d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.727815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c853614-cf71-4ed4-a704-a633357d886d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.730335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c853614-cf71-4ed4-a704-a633357d886d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.730335] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c853614-cf71-4ed4-a704-a633357d886d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.853909] env[65087]: INFO networking_nsxv3.common.synchronization [None req-79ce34a0-ec8c-4a3e-a223-8643dcee599d tempest-ImagesOneServerNegativeTestJSON-1111695184 tempest-ImagesOneServerNegativeTestJSON-1111695184-project-member] Enqueued Resource ID: 8c853614-cf71-4ed4-a704-a633357d886d with Priority: HIGHEST for action security_group_rules [ 1006.854586] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c853614-cf71-4ed4-a704-a633357d886d with Priority: HIGHEST for action security_group_rules [ 1006.854902] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c853614-cf71-4ed4-a704-a633357d886d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.855553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c853614-cf71-4ed4-a704-a633357d886d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.257127] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.257394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.257491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.257716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.257810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.257953] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c853614-cf71-4ed4-a704-a633357d886d already deleted. [ 1007.258054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c853614-cf71-4ed4-a704-a633357d886d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.258296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c853614-cf71-4ed4-a704-a633357d886d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.258463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c853614-cf71-4ed4-a704-a633357d886d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.258550] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c853614-cf71-4ed4-a704-a633357d886d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.292409] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1007.292545] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:2 started [ 1007.783027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.783027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.783027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.783027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.783027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.783027] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c853614-cf71-4ed4-a704-a633357d886d already deleted. [ 1007.783027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c853614-cf71-4ed4-a704-a633357d886d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.981026] env[65087]: INFO networking_nsxv3.common.synchronization [req-f56beac2-9783-4944-bd47-8454145d1c1a req-38f01d68-1914-4c29-80fe-3a7ba341a364 tempest-ServerGroupTestJSON-419703568 tempest-ServerGroupTestJSON-419703568-project-member] Enqueued Resource ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e with Priority: HIGHEST for action security_group_members [ 1007.981026] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e with Priority: HIGHEST for action security_group_members [ 1007.982651] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c1371be0-e403-4fc8-b7ba-48edcbdada5e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.982889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.983019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.983286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.983551] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.983783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.983899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.984114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.984250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.984389] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c1371be0-e403-4fc8-b7ba-48edcbdada5e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.487161] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.487321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.487321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.487536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.487749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.487827] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.487911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.487976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.488142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.488217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.488301] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e is going to be updated. [ 1008.517671] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.517982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.518107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.518390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.518598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.527451] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e in Status: IN_PROGRESS for 2s [ 1008.685199] env[65087]: INFO networking_nsxv3.common.synchronization [None req-810af448-0291-49bd-a86c-69133b55080d None None] Enqueued Resource ID: 00429a52-f521-4309-8f31-7e12c3eb11c6 with Priority: HIGHEST for action port [ 1008.685848] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00429a52-f521-4309-8f31-7e12c3eb11c6 with Priority: HIGHEST for action port [ 1008.686257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-00429a52-f521-4309-8f31-7e12c3eb11c6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.686407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00429a52-f521-4309-8f31-7e12c3eb11c6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.686492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00429a52-f521-4309-8f31-7e12c3eb11c6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.686847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00429a52-f521-4309-8f31-7e12c3eb11c6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.686947] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00429a52-f521-4309-8f31-7e12c3eb11c6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.867112] env[65087]: INFO networking_nsxv3.common.synchronization [req-e43cc038-ee38-4ff0-b46d-9a547518fdc9 req-e49b4a04-945b-474f-b424-e176ece1b6e5 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1008.867423] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1008.867726] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.867863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.867904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.868118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.868270] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.868419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.868419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.868569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.868657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.868770] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.189131] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00429a52-f521-4309-8f31-7e12c3eb11c6 [ 1009.189371] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.189600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.189600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.189786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.189876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.189970] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00429a52-f521-4309-8f31-7e12c3eb11c6 already deleted. [ 1009.190066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00429a52-f521-4309-8f31-7e12c3eb11c6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.203584] env[65087]: INFO networking_nsxv3.common.synchronization [None req-43e25f9c-7fc6-42cf-ad64-5e9bbec982be tempest-ServerActionsTestOtherB-1688726736 tempest-ServerActionsTestOtherB-1688726736-project-member] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1009.205161] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1009.206521] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.206774] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.206979] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.207277] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.207758] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.207758] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.207941] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.207998] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.208165] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.208397] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.208551] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.208610] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.208789] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.208913] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.208976] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.209168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.210284] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.210432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.210466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.211032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.211032] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.233877] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.234101] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.234241] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.234454] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.234781] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-186f292f-4436-4d46-b55e-85c15271c57c taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.234952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-186f292f-4436-4d46-b55e-85c15271c57c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.235101] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-186f292f-4436-4d46-b55e-85c15271c57c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.235422] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-186f292f-4436-4d46-b55e-85c15271c57c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.235558] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('186f292f-4436-4d46-b55e-85c15271c57c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.291166] env[65087]: INFO networking_nsxv3.common.synchronization [None req-63721f89-274e-4a60-a852-cc394b82d0d6 tempest-ServerActionsTestOtherB-1688726736 tempest-ServerActionsTestOtherB-1688726736-project-member] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1009.291852] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1009.292498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.292599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.371166] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.371330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.371400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.371646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.396946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.397329] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.397835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.397835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.398216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.398333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.398447] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1009.428707] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.428844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.428893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.429224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.429520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.440350] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1009.735463] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.735674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.735761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.736028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.736181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.736280] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49706196-d349-4818-ae7e-d6615560719a already deleted. [ 1009.736374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.737051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.737267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.737353] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.739272] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.739585] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.739758] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.740123] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.740365] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.740519] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 186f292f-4436-4d46-b55e-85c15271c57c not found, creating... [ 1009.740819] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.741031] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.741189] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.741450] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.742024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.742372] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.742581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.742738] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.742976] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.743162] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.743327] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 186f292f-4436-4d46-b55e-85c15271c57c is going to be created. [ 1009.769849] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.770280] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.770280] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.770470] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.770700] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.770928] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-186f292f-4436-4d46-b55e-85c15271c57c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.272557] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.273165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.273165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.273165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.273165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.273165] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49706196-d349-4818-ae7e-d6615560719a already deleted. [ 1010.273398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.511208] env[65087]: INFO networking_nsxv3.common.synchronization [req-e43cc038-ee38-4ff0-b46d-9a547518fdc9 req-e73d5fcf-03cc-4acd-9c38-cc868246d5d0 service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 1010.511208] env[65087]: INFO networking_nsxv3.common.synchronization [req-e43cc038-ee38-4ff0-b46d-9a547518fdc9 req-e73d5fcf-03cc-4acd-9c38-cc868246d5d0 service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1010.511208] env[65087]: INFO networking_nsxv3.common.synchronization [req-e43cc038-ee38-4ff0-b46d-9a547518fdc9 req-e73d5fcf-03cc-4acd-9c38-cc868246d5d0 service nova] Enqueued Resource ID: 186f292f-4436-4d46-b55e-85c15271c57c with Priority: HIGHEST for action port [ 1010.512200] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 1010.512200] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1010.512200] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 186f292f-4436-4d46-b55e-85c15271c57c with Priority: HIGHEST for action port [ 1010.512200] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.512479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.512479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.512641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.512641] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.513559] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.513675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.514118] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-186f292f-4436-4d46-b55e-85c15271c57c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.514118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-186f292f-4436-4d46-b55e-85c15271c57c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.514118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-186f292f-4436-4d46-b55e-85c15271c57c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.514346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-186f292f-4436-4d46-b55e-85c15271c57c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.514346] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('186f292f-4436-4d46-b55e-85c15271c57c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.540578] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e in Status: SUCCESS [ 1010.540861] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c1371be0-e403-4fc8-b7ba-48edcbdada5e deletion is rescheduled due to dependency. [ 1010.540965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c1371be0-e403-4fc8-b7ba-48edcbdada5e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.016795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.017036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.017146] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 186f292f-4436-4d46-b55e-85c15271c57c with status ACTIVE [ 1011.017325] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.017441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.017515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.017772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.017871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.018083] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.018186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.018245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.018400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.018478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.018656] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.018761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.018855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.019025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.019112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.019199] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 186f292f-4436-4d46-b55e-85c15271c57c is going to be updated. [ 1011.044544] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.044544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.044544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.044931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.044931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.044931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-186f292f-4436-4d46-b55e-85c15271c57c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.452586] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1011.453044] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd deletion is rescheduled due to dependency. [ 1011.453044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.453251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.453437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.453696] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.453863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.453914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.454125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.454193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.454308] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.957654] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.459672] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.802520] env[65087]: INFO networking_nsxv3.common.synchronization [None req-e53ec8d1-7b95-4d8e-b76e-63cfacaff0cf tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 646e135a-8ff8-40a7-902b-6ecb70ff0afa with Priority: HIGHEST for action security_group_rules [ 1012.803105] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e135a-8ff8-40a7-902b-6ecb70ff0afa with Priority: HIGHEST for action security_group_rules [ 1012.803415] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.803552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.803702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.803965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.804216] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('646e135a-8ff8-40a7-902b-6ecb70ff0afa',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.910068] env[65087]: INFO networking_nsxv3.common.synchronization [None req-0a5df1b0-28ed-4c4c-b0b3-7381dc18c243 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 646e135a-8ff8-40a7-902b-6ecb70ff0afa with Priority: HIGHEST for action security_group_rules [ 1012.910660] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 646e135a-8ff8-40a7-902b-6ecb70ff0afa with Priority: HIGHEST for action security_group_rules [ 1012.910975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.911236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.963046] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.963046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.963046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.963284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.963373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.963485] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1012.996107] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.996354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.996472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.996812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.997053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.013916] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1013.331213] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.331213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.331213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.331213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.331213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.331412] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 646e135a-8ff8-40a7-902b-6ecb70ff0afa already deleted. [ 1013.331412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.331654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.331828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.332009] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('646e135a-8ff8-40a7-902b-6ecb70ff0afa',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.799880] env[65087]: INFO networking_nsxv3.common.synchronization [req-3b905b3f-88ef-4538-a6e8-c6c775ea89ba req-159562c5-e165-4b33-a4d2-e8ea7658eb00 tempest-AttachVolumeShelveTestJSON-1249647460 tempest-AttachVolumeShelveTestJSON-1249647460-project-member] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_members [ 1013.800627] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGHEST for action security_group_members [ 1013.801126] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.801256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.801339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.801642] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.801836] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.802018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.802128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.802373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.802494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.802594] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.862808] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.862959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.863041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.863261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.863912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.863912] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 646e135a-8ff8-40a7-902b-6ecb70ff0afa already deleted. [ 1013.863912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-646e135a-8ff8-40a7-902b-6ecb70ff0afa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.306418] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.306749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.306749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.306958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.306958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.307251] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.307414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.307479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.307651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.307712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.307816] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ae9556d-2824-4426-9646-69904ca4036b is going to be updated. [ 1014.353594] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.353948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.354090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.356624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.356777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.369161] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: IN_PROGRESS for 2s [ 1014.685992] env[65087]: INFO networking_nsxv3.common.synchronization [req-ca296270-dd88-466d-a933-566eccf3371b req-4f39de2c-b4de-4620-a49d-8f300c4e03e7 tempest-ServersWithSpecificFlavorTestJSON-635744001 tempest-ServersWithSpecificFlavorTestJSON-635744001-project-member] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 1014.686549] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGHEST for action security_group_members [ 1014.686884] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.687052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.687168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.687268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.687843] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.687978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.687978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.688326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.688326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.688326] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.026534] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1015.027110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.027110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.027220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.028336] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.028336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.028336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.028336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.028336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.028336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.028336] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.191029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.191358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.191358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.195017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.213815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.214332] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.214507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.214599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.214908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.215038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.215139] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 is going to be updated. [ 1015.248627] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.248916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.248973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.249676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.249861] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.264070] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: IN_PROGRESS for 2s [ 1015.530889] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.531085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.531171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.531379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.531543] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.531883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.531883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.531883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.532061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.532061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.532156] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.532260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.532314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.532441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.532575] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.532663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.532736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.532858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.532930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.533023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.533206] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.593658] env[65087]: INFO networking_nsxv3.common.synchronization [None req-ec5c3dc4-1493-41fa-b87d-d81edb74580e tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1015.594781] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1015.594781] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.594781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.594781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.595313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.595313] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.595313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.595313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.595521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.595521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.595521] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.037739] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 078ba4a4-0e86-4b25-838d-1fc110729dbd: rpc.has_security_group_logging(os_id): False [ 1016.064924] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.065116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.065281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.065414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.065507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.065853] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.066019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.066102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.066270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.066363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.066702] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.067400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.067543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.067713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.067804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.068047] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.068157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.068223] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.068399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.068480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.068571] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1016.097406] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.137259] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.137447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.137496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.137840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.137923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.153340] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1016.381154] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ae9556d-2824-4426-9646-69904ca4036b in Status: SUCCESS [ 1016.381154] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ae9556d-2824-4426-9646-69904ca4036b deletion is rescheduled due to dependency. [ 1016.381341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.405974] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5ad64427-b33f-44a8-9bc9-53e8a163d256 None None] Enqueued Resource ID: 8b29ee17-21f0-4d2e-83f4-33c363ff6b34 with Priority: HIGHEST for action port [ 1016.406784] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b29ee17-21f0-4d2e-83f4-33c363ff6b34 with Priority: HIGHEST for action port [ 1016.407171] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b29ee17-21f0-4d2e-83f4-33c363ff6b34 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.407331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b29ee17-21f0-4d2e-83f4-33c363ff6b34" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.407390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b29ee17-21f0-4d2e-83f4-33c363ff6b34" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.407692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b29ee17-21f0-4d2e-83f4-33c363ff6b34" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.407797] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b29ee17-21f0-4d2e-83f4-33c363ff6b34',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.599550] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.888979] env[65087]: INFO networking_nsxv3.common.synchronization [req-be3dcefa-90ca-48b5-8d78-139543d4426e req-d54a5427-dd1a-4b55-a79a-c2dd96c68a69 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1016.889629] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1016.889950] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.890061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.890539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.890539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.890539] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.890748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.890748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.890904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.890996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.891128] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.914267] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b29ee17-21f0-4d2e-83f4-33c363ff6b34 [ 1016.914267] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.914267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.914267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.914267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.914267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.914267] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b29ee17-21f0-4d2e-83f4-33c363ff6b34 already deleted. [ 1016.914267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b29ee17-21f0-4d2e-83f4-33c363ff6b34" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.104408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.104408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.104408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.106905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.106905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.106905] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1017.141825] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.142118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.142118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.142423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.142634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.153942] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1017.278193] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 in Status: SUCCESS [ 1017.278193] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 deletion is rescheduled due to dependency. [ 1017.278193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.395394] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.395842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.395970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.396320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.396320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.396518] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.396627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.396691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.399196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.399196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.399196] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1017.430981] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.431156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.431315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.431664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.431911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.442552] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1017.605577] env[65087]: INFO networking_nsxv3.common.synchronization [req-06aed91e-b510-4f57-873c-a5f8c47eae58 req-4e2d281b-6109-44c6-822f-dbc3402569da tempest-ImagesOneServerNegativeTestJSON-1111695184 tempest-ImagesOneServerNegativeTestJSON-1111695184-project-member] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1017.606155] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1017.606471] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.606580] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.606651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.606855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.607030] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.607141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.607204] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.607356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.607441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.607546] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.016649] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.016649] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.016942] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.018253] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.018939] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.019211] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.019369] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.019666] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.019867] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.020108] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.020356] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.020479] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.020667] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.020790] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.020909] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.021125] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.042423] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.042922] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.043093] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.043248] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.043605] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-b9c5293c-5a45-47b5-94df-baf47a5139b2 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.043813] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-b9c5293c-5a45-47b5-94df-baf47a5139b2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.043962] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-b9c5293c-5a45-47b5-94df-baf47a5139b2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.044500] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-b9c5293c-5a45-47b5-94df-baf47a5139b2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.044708] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9c5293c-5a45-47b5-94df-baf47a5139b2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.111815] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.111815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.111815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.111815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.111815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.111815] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.111815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.111815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.111815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.111815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.111815] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be updated. [ 1018.138075] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.138075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.138075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.138075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.138348] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.146444] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: IN_PROGRESS for 2s [ 1018.166917] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1018.167184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.173940] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.174156] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.174279] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.174546] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.174802] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.174959] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.175088] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.175311] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.175452] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.175658] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.175842] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.175954] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.176075] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.176190] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.176293] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.176423] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.197709] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.197882] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.198029] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.198248] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.198565] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-88b771de-77b2-4443-884f-095131bff6be taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.198738] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-88b771de-77b2-4443-884f-095131bff6be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.198861] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-88b771de-77b2-4443-884f-095131bff6be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.199268] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-88b771de-77b2-4443-884f-095131bff6be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.199412] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88b771de-77b2-4443-884f-095131bff6be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.547103] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.547338] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.547465] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.547740] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.547892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.548186] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port b9c5293c-5a45-47b5-94df-baf47a5139b2 not found, creating... [ 1018.548516] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.548687] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.548810] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.549048] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.549193] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.549487] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.549643] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.549758] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.549967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.550112] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.550248] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: b9c5293c-5a45-47b5-94df-baf47a5139b2 is going to be created. [ 1018.570233] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.570233] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.570355] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.570628] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.570940] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.571193] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-b9c5293c-5a45-47b5-94df-baf47a5139b2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.598569] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5051f9e9-e7e4-4347-96cb-ad23dc54f52f None None] Enqueued Resource ID: e74506f2-223d-4e16-8968-8d55c329e508 with Priority: HIGHEST for action port [ 1018.599161] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e74506f2-223d-4e16-8968-8d55c329e508 with Priority: HIGHEST for action port [ 1018.599475] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e74506f2-223d-4e16-8968-8d55c329e508 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.599601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e74506f2-223d-4e16-8968-8d55c329e508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.599670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e74506f2-223d-4e16-8968-8d55c329e508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.599927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e74506f2-223d-4e16-8968-8d55c329e508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.600033] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e74506f2-223d-4e16-8968-8d55c329e508',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.702038] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.702328] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.702427] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.702708] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.702860] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.703022] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 88b771de-77b2-4443-884f-095131bff6be not found, creating... [ 1018.703298] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.703458] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.703580] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.703876] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.704049] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.704349] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.704557] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.704687] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.705023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.705023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.705168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 88b771de-77b2-4443-884f-095131bff6be is going to be created. [ 1018.727634] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.728063] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.728063] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.728451] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.729196] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.729474] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-88b771de-77b2-4443-884f-095131bff6be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.102047] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e74506f2-223d-4e16-8968-8d55c329e508 [ 1019.102383] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.102541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.102541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.102718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.102845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.102918] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e74506f2-223d-4e16-8968-8d55c329e508 already deleted. [ 1019.102980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e74506f2-223d-4e16-8968-8d55c329e508" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.164194] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1019.164654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.302501] env[65087]: INFO networking_nsxv3.common.synchronization [req-06aed91e-b510-4f57-873c-a5f8c47eae58 req-15b4983a-6903-43b0-9a81-d3bde3a438e4 service nova] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_rules [ 1019.303693] env[65087]: INFO networking_nsxv3.common.synchronization [req-06aed91e-b510-4f57-873c-a5f8c47eae58 req-15b4983a-6903-43b0-9a81-d3bde3a438e4 service nova] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1019.303693] env[65087]: INFO networking_nsxv3.common.synchronization [req-06aed91e-b510-4f57-873c-a5f8c47eae58 req-15b4983a-6903-43b0-9a81-d3bde3a438e4 service nova] Enqueued Resource ID: b9c5293c-5a45-47b5-94df-baf47a5139b2 with Priority: HIGHEST for action port [ 1019.304099] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_rules [ 1019.304387] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1019.304922] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9c5293c-5a45-47b5-94df-baf47a5139b2 with Priority: HIGHEST for action port [ 1019.305194] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.305811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.306383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.307246] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.307628] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.309092] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.309092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.309638] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9c5293c-5a45-47b5-94df-baf47a5139b2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.312027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9c5293c-5a45-47b5-94df-baf47a5139b2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.312027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9c5293c-5a45-47b5-94df-baf47a5139b2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.312027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9c5293c-5a45-47b5-94df-baf47a5139b2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.312027] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9c5293c-5a45-47b5-94df-baf47a5139b2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.454432] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1019.454432] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 1019.454432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.458038] env[65087]: INFO networking_nsxv3.common.synchronization [req-16ea0494-ae69-4646-853a-47859605be5e req-43b3b308-c21c-42c1-be96-87b6fc32ba2b service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 1019.458038] env[65087]: INFO networking_nsxv3.common.synchronization [req-16ea0494-ae69-4646-853a-47859605be5e req-43b3b308-c21c-42c1-be96-87b6fc32ba2b service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1019.458038] env[65087]: INFO networking_nsxv3.common.synchronization [req-16ea0494-ae69-4646-853a-47859605be5e req-43b3b308-c21c-42c1-be96-87b6fc32ba2b service nova] Enqueued Resource ID: 88b771de-77b2-4443-884f-095131bff6be with Priority: HIGHEST for action port [ 1019.458038] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 1019.458499] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1019.459604] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88b771de-77b2-4443-884f-095131bff6be with Priority: HIGHEST for action port [ 1019.459604] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.459826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.459999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.461297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.461297] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.462090] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.464031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.464031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.464031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.464031] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.464031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.467408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.467408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.467493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.467571] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.468490] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-88b771de-77b2-4443-884f-095131bff6be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.468603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88b771de-77b2-4443-884f-095131bff6be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.468657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88b771de-77b2-4443-884f-095131bff6be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.468841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88b771de-77b2-4443-884f-095131bff6be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.468912] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88b771de-77b2-4443-884f-095131bff6be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.756843] env[65087]: INFO networking_nsxv3.common.synchronization [req-74c0baa0-21d1-4069-9e19-514f389820e1 req-96f331c7-4491-42b2-ba49-0a4d70eebd76 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_members [ 1019.757458] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGHEST for action security_group_members [ 1019.757853] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.757976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.758088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.758269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.758467] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.758533] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.758576] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.758724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.758810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.758958] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.816685] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.816685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.816685] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9c5293c-5a45-47b5-94df-baf47a5139b2 with status ACTIVE [ 1019.816685] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.816685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.816685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.816685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.816685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.816685] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.816685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.816685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.817190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.817333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.817620] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.817777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.817885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.818121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.818263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.818453] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9c5293c-5a45-47b5-94df-baf47a5139b2 is going to be updated. [ 1019.846034] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.846034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.846034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.846034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.846034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.846988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9c5293c-5a45-47b5-94df-baf47a5139b2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.944202] env[65087]: INFO networking_nsxv3.common.synchronization [req-26ddb9df-0a30-4768-8e38-ac1a498975b0 req-fa536af5-04ac-4085-9355-c0cc29de75f9 tempest-ServerActionsTestOtherB-1688726736 tempest-ServerActionsTestOtherB-1688726736-project-member] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1019.944202] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1019.944202] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.944202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.944202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.945102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.945594] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.946461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.949102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.949102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.949102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.949102] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.970846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.971018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.971259] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.973034] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88b771de-77b2-4443-884f-095131bff6be with status ACTIVE [ 1019.973034] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.973034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.973034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.973430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.973430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.973513] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.974193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.974301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.976020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.976020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.976020] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.976020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.976020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.976020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.976020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.976020] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88b771de-77b2-4443-884f-095131bff6be is going to be updated. [ 1020.012577] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.012716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.012789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.013026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.013201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.013412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88b771de-77b2-4443-884f-095131bff6be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.159978] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 1020.159978] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca deletion is rescheduled due to dependency. [ 1020.159978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.160563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.160563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.160563] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.160693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.160728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.160851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.160932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.161036] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.264280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.264575] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.264575] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.264724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.264820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.265029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.265135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.265213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.265384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.265446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.265531] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 is going to be updated. [ 1020.293416] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.293624] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.293754] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.295224] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.295527] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.295740] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.295999] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.296286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.296432] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.296664] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.296803] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.296889] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.296999] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.297111] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.297210] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.297343] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.300248] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.300433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.300433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.300633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.300775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.313158] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 in Status: IN_PROGRESS for 2s [ 1020.325827] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.326380] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.326380] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.327188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.327680] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-05a34b27-45d6-4918-aa52-858b8882ed94 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.327990] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-05a34b27-45d6-4918-aa52-858b8882ed94" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.328322] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-05a34b27-45d6-4918-aa52-858b8882ed94" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.328628] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-05a34b27-45d6-4918-aa52-858b8882ed94" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.328843] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05a34b27-45d6-4918-aa52-858b8882ed94',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.380592] env[65087]: INFO networking_nsxv3.common.synchronization [None req-6a8bb617-bcd2-48c6-9024-a0617342e3e0 tempest-ServersV294TestFqdnHostnames-1699101108 tempest-ServersV294TestFqdnHostnames-1699101108-project-member] Enqueued Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_rules [ 1020.380592] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_rules [ 1020.380958] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7083382f-6e66-45d0-9fc4-efa15b381900 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.381060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.381102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.383290] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.383455] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.450327] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.450487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.450560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.450846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.450955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.451176] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.451297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.451364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.451536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.451619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.451707] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a already deleted. [ 1020.451800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.479037] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.539308] env[65087]: INFO networking_nsxv3.common.synchronization [None req-0dd49d0f-d9c5-42bf-af95-dbdfe1d12521 tempest-ServersV294TestFqdnHostnames-1699101108 tempest-ServersV294TestFqdnHostnames-1699101108-project-member] Enqueued Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_rules [ 1020.539308] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_rules [ 1020.540285] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7083382f-6e66-45d0-9fc4-efa15b381900 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.540285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.664138] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.832347] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.832713] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.832950] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.833835] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.833910] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.834059] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 05a34b27-45d6-4918-aa52-858b8882ed94 not found, creating... [ 1020.834363] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.834549] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.834671] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.834945] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.835118] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.835441] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.835620] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.835772] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.836013] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.836188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.836434] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 05a34b27-45d6-4918-aa52-858b8882ed94 is going to be created. [ 1020.858407] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.858636] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.858804] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.859062] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.859324] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.859581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-05a34b27-45d6-4918-aa52-858b8882ed94" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.914767] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.915012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.915012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.915216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.915343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.915458] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7083382f-6e66-45d0-9fc4-efa15b381900 already deleted. [ 1020.915516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.915687] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.916143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.916143] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.982561] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.982733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.982809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.983043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.983138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.983237] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1021.038243] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.038487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.038748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.038890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.038939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.050027] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1021.169163] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.440356] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.440660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.440660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.440790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.440874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.440971] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7083382f-6e66-45d0-9fc4-efa15b381900 already deleted. [ 1021.441061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.454836] env[65087]: INFO networking_nsxv3.common.synchronization [req-0e6f239b-ea5e-4982-8788-c16eab45dd5d req-893d9c57-22a0-4445-a286-0ff2b93a7414 tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1021.455357] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1021.455656] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.455797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.455870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.456133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.456309] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.456411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.456475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.456626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.456760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.456824] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.588236] env[65087]: INFO networking_nsxv3.common.synchronization [req-26ddb9df-0a30-4768-8e38-ac1a498975b0 req-9872edcb-940f-4d1d-8794-e9e04c9ce8be service nova] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1021.588403] env[65087]: INFO networking_nsxv3.common.synchronization [req-26ddb9df-0a30-4768-8e38-ac1a498975b0 req-9872edcb-940f-4d1d-8794-e9e04c9ce8be service nova] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1021.588648] env[65087]: INFO networking_nsxv3.common.synchronization [req-26ddb9df-0a30-4768-8e38-ac1a498975b0 req-9872edcb-940f-4d1d-8794-e9e04c9ce8be service nova] Enqueued Resource ID: 05a34b27-45d6-4918-aa52-858b8882ed94 with Priority: HIGHEST for action port [ 1021.589028] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1021.589152] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1021.589246] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a34b27-45d6-4918-aa52-858b8882ed94 with Priority: HIGHEST for action port [ 1021.589512] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.589660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.589696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.589878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.589987] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.591114] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.591114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.591114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.591114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.591320] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.591377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.591419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.591623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.591623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.591879] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.592631] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-05a34b27-45d6-4918-aa52-858b8882ed94 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.592732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05a34b27-45d6-4918-aa52-858b8882ed94" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.592807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05a34b27-45d6-4918-aa52-858b8882ed94" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.593097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05a34b27-45d6-4918-aa52-858b8882ed94" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.593097] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05a34b27-45d6-4918-aa52-858b8882ed94',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.672929] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.673092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.673092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.673314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.673412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.673520] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be updated. [ 1021.712436] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.712622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.712689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.712857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.713413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.723198] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: IN_PROGRESS for 2s [ 1021.959729] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.959894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.959973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.960173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.960258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.960453] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.960555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.960633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.960752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.960826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.960909] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1021.989837] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.990049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.990118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.990310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.990493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.000607] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1022.095047] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.096275] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.096413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.096565] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05a34b27-45d6-4918-aa52-858b8882ed94 with status ACTIVE [ 1022.096752] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.096915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.096994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.097214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.097304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.097568] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.097678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.097727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.097907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.098028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.098174] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.098284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.098326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.098461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.098536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.098619] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05a34b27-45d6-4918-aa52-858b8882ed94 is going to be updated. [ 1022.121539] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.121700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.121746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.121965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.122124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.122287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05a34b27-45d6-4918-aa52-858b8882ed94" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.328723] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 in Status: SUCCESS [ 1022.328934] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 deletion is rescheduled due to dependency. [ 1022.329047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.601863] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.064860] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1023.064860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.064860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.064860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.065168] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.065168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.065257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.065412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.065497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.065587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.065681] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.103636] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.103841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.103914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.104499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.104499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.104499] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be created. [ 1023.132132] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.132320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.132363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.132569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.132731] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.147735] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: UNINITIALIZED for 2s [ 1023.568629] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.568848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.568974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.569257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.569564] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.569909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.569909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.570119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.570233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.570338] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.570511] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.570629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.570741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.570859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.571019] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.571140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.571199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.571354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.571448] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.571552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.571663] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.737415] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 1023.737671] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.737809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.738107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.738261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.738375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.738441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.738612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.738687] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.738770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.738873] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.010260] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1024.010446] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1024.010718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.073984] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 078ba4a4-0e86-4b25-838d-1fc110729dbd: rpc.has_security_group_logging(os_id): False [ 1024.105675] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.105871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.105970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.106582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.106582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.106582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.106582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.106978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.106978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.106978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.107101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.107164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.107217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.107529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.107529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.107637] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.107692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.107729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.107869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.107970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.108670] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1024.145891] env[65087]: INFO networking_nsxv3.common.synchronization [None req-96e47874-dba0-4096-9ebe-616d343b7f37 tempest-AttachVolumeShelveTestJSON-1249647460 tempest-AttachVolumeShelveTestJSON-1249647460-project-member] Enqueued Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_rules [ 1024.146645] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_rules [ 1024.147075] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.147296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.147371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.147662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.147720] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.181114] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.181114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.181114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.181114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.181114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.200147] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1024.241332] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.241499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.242691] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.242691] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.242691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.243408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.243408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.243408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.243408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.243408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.243408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.243408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.243721] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.254228] env[65087]: INFO networking_nsxv3.common.synchronization [None req-4a7a83e3-4b14-408f-8a20-941d122d556a tempest-AttachVolumeShelveTestJSON-1249647460 tempest-AttachVolumeShelveTestJSON-1249647460-project-member] Enqueued Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_rules [ 1024.255246] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_rules [ 1024.255246] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.255375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.670135] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.670385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.670385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.670547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.670647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.670768] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 already deleted. [ 1024.670821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.671066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.671237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.671324] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.754166] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 336c99cf-6401-42f0-a311-bcd662eef8ca: rpc.has_security_group_logging(os_id): False [ 1024.779085] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.779265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.779311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.779521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.779619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.779847] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.779952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.780031] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.780561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.780561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.780561] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.780561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.780755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.780755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.780817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.781528] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.781528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.781528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.781528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.781528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.781528] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be updated. [ 1024.847380] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.847607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.847607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.848232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.848232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.865315] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: IN_PROGRESS for 2s [ 1025.160315] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1025.160553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.160719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.160941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.161337] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.161337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.161337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.161523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.161573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.161683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.161738] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.192101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.192369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.192369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.192532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.192773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.192773] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 already deleted. [ 1025.192916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.664973] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.089319] env[65087]: INFO networking_nsxv3.common.synchronization [req-6326f11f-a5ff-4ce3-8dec-53dacdaeb616 req-5fabb9a9-8170-4453-b197-52438a7c2695 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1026.093339] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1026.094220] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.094356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.094432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.094623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.094783] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.094884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.094948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.095120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.095256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.095362] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.166795] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49706196-d349-4818-ae7e-d6615560719a: rpc.has_security_group_logging(os_id): False [ 1026.189247] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.189508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.189508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.189767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.189853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.190842] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.190842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.190842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.190842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.190842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.190842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be created. [ 1026.214187] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1026.214419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.265862] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.267650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.267650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.267952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.268049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.282607] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1026.574712] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.574712] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.574712] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.575260] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.575424] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.575660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.575858] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.576169] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.576376] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.577064] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.577064] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.577309] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.577588] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.577842] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1026.577985] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.578220] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.598299] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.598680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.598680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.598992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.598992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.599262] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.599414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.599563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.599718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.599831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.599932] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1026.611094] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.611392] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1026.611540] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.611782] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.612295] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-71b64dfa-96b4-4afa-83bc-459350d7e9e9 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.612552] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-71b64dfa-96b4-4afa-83bc-459350d7e9e9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.612739] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-71b64dfa-96b4-4afa-83bc-459350d7e9e9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.613214] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-71b64dfa-96b4-4afa-83bc-459350d7e9e9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.613432] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b64dfa-96b4-4afa-83bc-459350d7e9e9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.645662] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.645907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.645907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.646500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.646500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.656899] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1026.883845] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 1026.884105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.116072] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.116487] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.116487] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.116715] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.116868] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.117037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 71b64dfa-96b4-4afa-83bc-459350d7e9e9 not found, creating... [ 1027.117310] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.117469] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.117584] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.117798] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.117936] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.118242] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.118433] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.118554] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.118757] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.119220] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.119220] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 71b64dfa-96b4-4afa-83bc-459350d7e9e9 is going to be created. [ 1027.141842] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.142087] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.142191] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.142480] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.142718] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.142945] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-71b64dfa-96b4-4afa-83bc-459350d7e9e9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.829157] env[65087]: INFO networking_nsxv3.common.synchronization [req-6326f11f-a5ff-4ce3-8dec-53dacdaeb616 req-a4f5abee-c377-4e73-9107-c97f0e571c6c service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 1027.829157] env[65087]: INFO networking_nsxv3.common.synchronization [req-6326f11f-a5ff-4ce3-8dec-53dacdaeb616 req-a4f5abee-c377-4e73-9107-c97f0e571c6c service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1027.829282] env[65087]: INFO networking_nsxv3.common.synchronization [req-6326f11f-a5ff-4ce3-8dec-53dacdaeb616 req-a4f5abee-c377-4e73-9107-c97f0e571c6c service nova] Enqueued Resource ID: 71b64dfa-96b4-4afa-83bc-459350d7e9e9 with Priority: HIGHEST for action port [ 1027.829774] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 1027.829913] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1027.830015] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b64dfa-96b4-4afa-83bc-459350d7e9e9 with Priority: HIGHEST for action port [ 1027.830504] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.830608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.830756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.830938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.830977] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.831957] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.832072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.832270] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-71b64dfa-96b4-4afa-83bc-459350d7e9e9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.832375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71b64dfa-96b4-4afa-83bc-459350d7e9e9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.832439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71b64dfa-96b4-4afa-83bc-459350d7e9e9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.832608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71b64dfa-96b4-4afa-83bc-459350d7e9e9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.832850] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b64dfa-96b4-4afa-83bc-459350d7e9e9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.295472] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1028.295937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.335968] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.336258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.336480] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71b64dfa-96b4-4afa-83bc-459350d7e9e9 with status ACTIVE [ 1028.336687] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.336808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.336923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.337228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.337408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.342023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.342023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.342023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.342023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.342023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.342023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.342023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.342023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.342023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.342023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.342023] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71b64dfa-96b4-4afa-83bc-459350d7e9e9 is going to be updated. [ 1028.369012] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.369232] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.369278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.369595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.369595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.369752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71b64dfa-96b4-4afa-83bc-459350d7e9e9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.674902] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1028.675148] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 1028.675228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.675465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.675615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.675890] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.675999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.675999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.676343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.676343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.676343] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.178824] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.603101] env[65087]: INFO networking_nsxv3.common.synchronization [None req-3efd9251-7fbc-4cad-a9a0-a4736731813c tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_rules [ 1029.603837] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_rules [ 1029.604272] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-664c49c8-8d39-49fa-b67a-7036d944867d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.604415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.604488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.604759] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.604839] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.681600] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.748641] env[65087]: INFO networking_nsxv3.common.synchronization [None req-e9ad8197-8a6a-4615-a92e-106a074b10e1 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_rules [ 1029.749302] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_rules [ 1029.749573] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-664c49c8-8d39-49fa-b67a-7036d944867d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.749685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.127350] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.127556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.127556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.127767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.127849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.128688] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 664c49c8-8d39-49fa-b67a-7036d944867d already deleted. [ 1030.128688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.128688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.128688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.128688] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.186423] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.186895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.187109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.187505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.188758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.188758] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1030.217201] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.217420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.217420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.217597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.217743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.225948] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1030.649728] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.650772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.650772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.650772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.650772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.650772] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 664c49c8-8d39-49fa-b67a-7036d944867d already deleted. [ 1030.650772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.235474] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 4s [ 1033.180813] env[65087]: INFO networking_nsxv3.common.synchronization [req-9152be5f-b378-4faa-8829-f23b740e4a5a req-acdb39f7-7ff1-460b-b77f-8359bc15dd22 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1033.181589] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1033.182865] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.182865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.182865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.182865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.182865] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.182865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.182865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.183263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.183263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.183263] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.586207] env[65087]: INFO networking_nsxv3.common.synchronization [None req-8c2f25d5-953c-4555-bb44-498288d8f38d tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1033.590020] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1033.590020] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.590020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.685206] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.188661] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.246279] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1034.246482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.246651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.246865] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.247077] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.247245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.247332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.247493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.247588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.247693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.247822] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.691022] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.691654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.691654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.691654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.691919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.691919] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1034.723435] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.723435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.723435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.723723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.723920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.735031] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1034.751135] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.751135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.751330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.751400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.751576] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.751672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.751738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.751913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.752018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.752116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.752325] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.752406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.752447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.752582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.752737] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.752836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.752915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.753085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.753169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.753248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.753349] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.255976] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e5af08c-4029-463c-937e-2ea7bf68d7d1: rpc.has_security_group_logging(os_id): False [ 1035.277878] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.278123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.278123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.278327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.278423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.278655] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.278761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.278825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.279114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.279248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.279441] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.279538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.279602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.279746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.279822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.280007] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.280117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.280180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.280320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.280391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.280475] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1035.367576] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.367819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.367819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.368167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.368472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.394722] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1035.743423] env[65087]: INFO networking_nsxv3.common.synchronization [req-f1d0e5d3-7c86-4b00-97b5-42c50dd0e200 req-2d8f25cb-e1d4-4fae-8e41-ac900ac0081f tempest-ServersV294TestFqdnHostnames-1699101108 tempest-ServersV294TestFqdnHostnames-1699101108-project-member] Enqueued Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_members [ 1035.744095] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_members [ 1035.744640] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-7083382f-6e66-45d0-9fc4-efa15b381900 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.744787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.744879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.745201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.745399] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.745527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.745615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.745843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.746043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.746176] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.132878] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.133045] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-907" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.133202] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-907" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.133462] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-907" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.133723] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.133891] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.134098] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.134286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.134437] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.134651] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.134758] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.134872] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.134972] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.135099] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.135207] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.135339] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.157030] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.157240] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1036.157365] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.157547] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-907" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.157888] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.158082] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.158207] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.158554] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.158696] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.250399] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.250399] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.250399] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7083382f-6e66-45d0-9fc4-efa15b381900 already deleted. [ 1036.250399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.309098] env[65087]: INFO networking_nsxv3.common.synchronization [req-69f05e51-8d4e-41d3-8f99-1d72be46bbf1 req-ffc460ed-6e9f-489f-b1e5-e8b8495d4bc2 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_members [ 1036.309098] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGHEST for action security_group_members [ 1036.314284] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.314451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.314542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.314744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.314923] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.315034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.315400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.315400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.315400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.315542] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.662022] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.662284] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.662427] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.662758] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.662938] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.663330] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee not found, creating... [ 1036.663574] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.663749] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.663872] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.664146] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.664328] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.664655] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.664797] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.664912] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.665270] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.665449] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.665608] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee is going to be created. [ 1036.689826] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.692244] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.692244] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.692244] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.692244] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.692244] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.753351] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1036.753879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.754105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.754346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.754656] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.755247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.755247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.755247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.755247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.755247] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.819189] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.819189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.819189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.819189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.819189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.822027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.822027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.822027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.822027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.822027] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.822027] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 is going to be updated. [ 1036.872880] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.873115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.873168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.873398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.873543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.885186] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 in Status: IN_PROGRESS for 2s [ 1037.259491] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.259741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.259741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.259936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.260051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.260273] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.260398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.260478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.260645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.260785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.260840] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1037.286751] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.286951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.287036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.287341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.287516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.316869] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1037.413965] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1037.414209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.711212] env[65087]: INFO networking_nsxv3.common.synchronization [req-f1d0e5d3-7c86-4b00-97b5-42c50dd0e200 req-ae70aa0e-da2b-4815-8346-e5b0db88d2f7 service nova] Enqueued Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_rules [ 1037.711402] env[65087]: INFO networking_nsxv3.common.synchronization [req-f1d0e5d3-7c86-4b00-97b5-42c50dd0e200 req-ae70aa0e-da2b-4815-8346-e5b0db88d2f7 service nova] Enqueued Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_members [ 1037.711539] env[65087]: INFO networking_nsxv3.common.synchronization [req-f1d0e5d3-7c86-4b00-97b5-42c50dd0e200 req-ae70aa0e-da2b-4815-8346-e5b0db88d2f7 service nova] Enqueued Resource ID: 8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee with Priority: HIGHEST for action port [ 1037.712301] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_rules [ 1037.712301] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_members [ 1037.712454] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee with Priority: HIGHEST for action port [ 1037.712640] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7083382f-6e66-45d0-9fc4-efa15b381900 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.712760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.712823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.713029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.713130] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.714130] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-7083382f-6e66-45d0-9fc4-efa15b381900 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.714222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.714355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.714448] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.714553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.714650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.714715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.714855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.714956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.715218] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.718636] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.718636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.718781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.718888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.718972] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.216019] env[65087]: INFO networking_nsxv3.common.synchronization [req-57cff97e-2797-4d5a-8e5a-c12202a6aef3 req-67905634-fa58-4a9e-a9a1-0ac63a1554b8 tempest-AttachVolumeShelveTestJSON-1249647460 tempest-AttachVolumeShelveTestJSON-1249647460-project-member] Enqueued Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_members [ 1038.216736] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_members [ 1038.218245] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.218245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.218245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.218468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.218553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.218663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.218729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.218879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.218967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.219372] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.223050] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-7083382f-6e66-45d0-9fc4-efa15b381900 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.223050] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee with status ACTIVE [ 1038.223050] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.223050] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.223050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.223050] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.223706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.223706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.223706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.223706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.223706] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee is going to be updated. [ 1038.224615] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.253400] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.253400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.253400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.253400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.253400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.253400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f12a8e3-d9c2-4e0a-8fc7-7f1c9c0a93ee" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.657156] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.657395] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.657537] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.657791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.658114] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.658227] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.658366] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.658677] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.658720] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.658919] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.659054] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.659186] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.659298] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.659411] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.659515] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.659648] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.680206] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.680399] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.680538] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.680713] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.681054] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.681236] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.681357] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.681743] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.681886] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbcb86ef-0454-48b0-919d-ffda6aa01f7b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.722045] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.722231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.722321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.722542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.722635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.722828] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.722928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.722997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.723175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.723272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.723361] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 already deleted. [ 1038.723444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.728187] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.895517] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 in Status: SUCCESS [ 1038.895851] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 deletion is rescheduled due to dependency. [ 1038.896094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.185100] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.185544] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.186320] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.186320] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.186320] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.186590] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port dbcb86ef-0454-48b0-919d-ffda6aa01f7b not found, creating... [ 1039.186654] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.187205] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.187205] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.187205] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.187581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.187581] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.187959] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.187959] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.188089] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.188286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.188603] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: dbcb86ef-0454-48b0-919d-ffda6aa01f7b is going to be created. [ 1039.210916] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.211214] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.211367] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.211670] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.211908] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.212168] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.231047] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.231593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.231593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.231819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.231906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.232034] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7083382f-6e66-45d0-9fc4-efa15b381900 is going to be created. [ 1039.281251] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.281251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.281454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.281515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.281705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.302360] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7083382f-6e66-45d0-9fc4-efa15b381900 in Status: UNINITIALIZED for 2s [ 1039.329604] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1039.329843] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd deletion is rescheduled due to dependency. [ 1039.329928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.927337] env[65087]: INFO networking_nsxv3.common.synchronization [req-57cff97e-2797-4d5a-8e5a-c12202a6aef3 req-4abdbd31-d7c4-4b98-8ade-200ac185b2c3 service nova] Enqueued Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_rules [ 1039.927337] env[65087]: INFO networking_nsxv3.common.synchronization [req-57cff97e-2797-4d5a-8e5a-c12202a6aef3 req-4abdbd31-d7c4-4b98-8ade-200ac185b2c3 service nova] Enqueued Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_members [ 1039.928396] env[65087]: INFO networking_nsxv3.common.synchronization [req-57cff97e-2797-4d5a-8e5a-c12202a6aef3 req-4abdbd31-d7c4-4b98-8ade-200ac185b2c3 service nova] Enqueued Resource ID: dbcb86ef-0454-48b0-919d-ffda6aa01f7b with Priority: HIGHEST for action port [ 1039.930202] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_rules [ 1039.930202] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_members [ 1039.930202] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb86ef-0454-48b0-919d-ffda6aa01f7b with Priority: HIGHEST for action port [ 1039.931074] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.931354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.935776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.935776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.935776] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.938057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.938057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.938057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.938057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.938057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.938057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.938438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.938438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.938438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.938438] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.939314] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.939515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.939515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.940016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.940016] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbcb86ef-0454-48b0-919d-ffda6aa01f7b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.443458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.443842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.443842] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.444918] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbcb86ef-0454-48b0-919d-ffda6aa01f7b with status ACTIVE [ 1040.445131] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.445131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.445238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.445638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.445638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.445638] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.445868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.445868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.445931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.445995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.446734] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.446734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.446734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.446734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.446734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.446734] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbcb86ef-0454-48b0-919d-ffda6aa01f7b is going to be updated. [ 1040.470423] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.470578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.470653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.470895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.471028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.471297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.568203] env[65087]: INFO networking_nsxv3.common.synchronization [req-5e4723b0-df03-44cb-a905-404b3ce9143d req-44304d8b-9bb3-4196-b3d0-a6edd603d7ea tempest-ImagesOneServerNegativeTestJSON-1111695184 tempest-ImagesOneServerNegativeTestJSON-1111695184-project-member] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1040.569763] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1040.573153] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.573153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.573153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.573153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.573153] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.573153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.573153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.573153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.573153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.573153] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.950337] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.074796] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.074796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.074796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.075248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.075248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.075323] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.075379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.075437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.075596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.075679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.075765] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be updated. [ 1041.109634] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.109634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.109634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.110054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.110203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.121637] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: IN_PROGRESS for 2s [ 1041.313193] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7083382f-6e66-45d0-9fc4-efa15b381900 in Status: SUCCESS [ 1041.313275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.313485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.313845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.314062] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.314185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.314250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.314626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.314705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.314804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.314880] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.452742] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.453311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.453311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.453311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.453311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.453311] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 is going to be created. [ 1041.477341] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.477550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.477599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.477837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.478014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.487676] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: UNINITIALIZED for 2s [ 1041.817506] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.167062] env[65087]: INFO networking_nsxv3.common.synchronization [req-3733d9cc-0adb-41c6-acce-ccca48ef28c3 req-f8e5d5b0-9efe-43bb-8e7e-ecfd6f5359e0 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_members [ 1042.167752] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_members [ 1042.168251] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-664c49c8-8d39-49fa-b67a-7036d944867d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.168389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.168457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.168811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.169725] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.169725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.169725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.169725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.169725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.169725] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.321230] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7083382f-6e66-45d0-9fc4-efa15b381900: rpc.has_security_group_logging(os_id): False [ 1042.345614] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.345932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.345995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.346438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.346842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.346940] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.347173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.347268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.347503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.347615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.347761] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7083382f-6e66-45d0-9fc4-efa15b381900 is going to be created. [ 1042.413869] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.414136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.414197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.414413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.414599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.428388] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7083382f-6e66-45d0-9fc4-efa15b381900 in Status: IN_PROGRESS for 2s [ 1042.576451] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.576793] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.576793] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.577096] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.577315] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.577491] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.577617] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.577842] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.578037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.578234] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.578395] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.578479] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.578588] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.578699] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.578870] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.578920] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.600232] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.600443] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.600644] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.600825] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.601170] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-1846c89f-7fd8-4843-a1f6-d7415447741c taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.601356] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-1846c89f-7fd8-4843-a1f6-d7415447741c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.601473] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-1846c89f-7fd8-4843-a1f6-d7415447741c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.601802] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-1846c89f-7fd8-4843-a1f6-d7415447741c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.601942] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1846c89f-7fd8-4843-a1f6-d7415447741c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.672119] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.672424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.672534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.672858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.673041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.673510] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.673651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.673762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.674046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.674193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.674393] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664c49c8-8d39-49fa-b67a-7036d944867d already deleted. [ 1042.674462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.104267] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.104532] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.104613] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.104896] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.105058] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.105216] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 1846c89f-7fd8-4843-a1f6-d7415447741c not found, creating... [ 1043.105477] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.105629] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.105744] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.105966] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.106145] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.106427] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.106581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.106695] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.106897] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.107070] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.107240] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 1846c89f-7fd8-4843-a1f6-d7415447741c is going to be created. [ 1043.126747] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.126967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.127075] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.127369] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.127583] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.127800] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-1846c89f-7fd8-4843-a1f6-d7415447741c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.131768] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 1043.131928] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca deletion is rescheduled due to dependency. [ 1043.132047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.497282] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: SUCCESS [ 1043.497463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.497630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.497848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.498059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.498180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.498250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.498419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.498510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.498599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.498695] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.887789] env[65087]: INFO networking_nsxv3.common.synchronization [req-3733d9cc-0adb-41c6-acce-ccca48ef28c3 req-ffc8519f-8c89-44bc-8f7f-b7618fff4d14 service nova] Enqueued Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_rules [ 1043.888204] env[65087]: INFO networking_nsxv3.common.synchronization [req-3733d9cc-0adb-41c6-acce-ccca48ef28c3 req-ffc8519f-8c89-44bc-8f7f-b7618fff4d14 service nova] Enqueued Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_members [ 1043.888204] env[65087]: INFO networking_nsxv3.common.synchronization [req-3733d9cc-0adb-41c6-acce-ccca48ef28c3 req-ffc8519f-8c89-44bc-8f7f-b7618fff4d14 service nova] Enqueued Resource ID: 1846c89f-7fd8-4843-a1f6-d7415447741c with Priority: HIGHEST for action port [ 1043.888873] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_rules [ 1043.888998] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_members [ 1043.889305] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1846c89f-7fd8-4843-a1f6-d7415447741c with Priority: HIGHEST for action port [ 1043.889711] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-664c49c8-8d39-49fa-b67a-7036d944867d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.889789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.889860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.890084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.890217] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.891830] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-664c49c8-8d39-49fa-b67a-7036d944867d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.891985] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.892079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.892312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.892477] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.893572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.893672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.897935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.897935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.897935] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.897935] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-1846c89f-7fd8-4843-a1f6-d7415447741c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.897935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1846c89f-7fd8-4843-a1f6-d7415447741c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.897935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1846c89f-7fd8-4843-a1f6-d7415447741c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.898241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1846c89f-7fd8-4843-a1f6-d7415447741c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.898241] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1846c89f-7fd8-4843-a1f6-d7415447741c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.001440] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.392850] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-664c49c8-8d39-49fa-b67a-7036d944867d taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.392850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.399180] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.402620] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1846c89f-7fd8-4843-a1f6-d7415447741c with status ACTIVE [ 1044.402872] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.403043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.403085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.404384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.404384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.404384] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.404384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.404384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.404384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.404384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.404384] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.404384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.404384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.404951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.404951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.404951] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1846c89f-7fd8-4843-a1f6-d7415447741c is going to be updated. [ 1044.428475] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.428719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.428719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.428908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.430144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.430144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1846c89f-7fd8-4843-a1f6-d7415447741c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.440013] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7083382f-6e66-45d0-9fc4-efa15b381900 in Status: SUCCESS [ 1044.440259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.505301] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8285264-bd0f-4381-9dd8-8b3192b9b544: rpc.has_security_group_logging(os_id): False [ 1044.524860] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.525098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.525098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.525290] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.525378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.525735] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.525926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.525926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.526026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.526118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.526205] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 is going to be created. [ 1044.545453] env[65087]: INFO networking_nsxv3.common.synchronization [req-7bc0dab6-a82e-4630-9e08-96a6367b8a8b req-931eed24-06d3-4282-b6ea-f58724828a29 tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1044.546110] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1044.546404] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.546565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.546644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.546905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.547069] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.547182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.547253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.547406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.547511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.547570] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.606749] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.606965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.606965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.607181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.607373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.626382] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: IN_PROGRESS for 2s [ 1044.870962] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.871553] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.871966] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.872429] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.872934] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.873298] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.874049] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.874049] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.874178] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.874498] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.874661] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.874798] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.875798] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.875798] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.875798] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.875798] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.897940] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.898332] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1044.898476] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.898690] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.899167] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.899451] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.899659] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.900900] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.901155] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26e87f9-65b9-4f4e-85b6-3b0bdd960326',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.903019] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.051819] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.051819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.051819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.051819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.051819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.051819] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.051819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.051819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.051819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.051819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.051819] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1045.084238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.084507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.084595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.084793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.085012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.095753] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1045.233772] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.234086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.234086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.234333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.234450] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.403676] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.403904] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.405354] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.405354] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.405354] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.405354] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port d26e87f9-65b9-4f4e-85b6-3b0bdd960326 not found, creating... [ 1045.405354] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.405354] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.405354] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.405712] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.405712] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.405978] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.407772] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.407913] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.408166] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.408333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.408497] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: d26e87f9-65b9-4f4e-85b6-3b0bdd960326 is going to be created. [ 1045.409732] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.409845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.409902] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.410072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.410156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.410243] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664c49c8-8d39-49fa-b67a-7036d944867d is going to be created. [ 1045.436666] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.436764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.436958] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.437334] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.439803] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.439803] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.439803] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.439803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.439803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.439803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.440175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.450823] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664c49c8-8d39-49fa-b67a-7036d944867d in Status: UNINITIALIZED for 2s [ 1045.737889] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.141150] env[65087]: INFO networking_nsxv3.common.synchronization [req-7bc0dab6-a82e-4630-9e08-96a6367b8a8b req-b308f051-9bc9-4c1d-b7db-c2c6336df2c0 service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 1046.141468] env[65087]: INFO networking_nsxv3.common.synchronization [req-7bc0dab6-a82e-4630-9e08-96a6367b8a8b req-b308f051-9bc9-4c1d-b7db-c2c6336df2c0 service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1046.141468] env[65087]: INFO networking_nsxv3.common.synchronization [req-7bc0dab6-a82e-4630-9e08-96a6367b8a8b req-b308f051-9bc9-4c1d-b7db-c2c6336df2c0 service nova] Enqueued Resource ID: d26e87f9-65b9-4f4e-85b6-3b0bdd960326 with Priority: HIGHEST for action port [ 1046.141972] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 1046.142122] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1046.142222] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d26e87f9-65b9-4f4e-85b6-3b0bdd960326 with Priority: HIGHEST for action port [ 1046.142542] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.142606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.142666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.142977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.142977] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.144388] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.144492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.144804] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.144915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.144985] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.145188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.145267] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26e87f9-65b9-4f4e-85b6-3b0bdd960326',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.240254] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.643622] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: SUCCESS [ 1046.643921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.645572] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.645880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.649307] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d26e87f9-65b9-4f4e-85b6-3b0bdd960326 with status ACTIVE [ 1046.649545] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.649745] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.649812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.650059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.650185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.650407] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.650531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.650597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.650765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.650843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.651040] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.651128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.651202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.651450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.652942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.652942] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d26e87f9-65b9-4f4e-85b6-3b0bdd960326 is going to be updated. [ 1046.700946] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.700946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.700946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.700946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.700946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.701520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d26e87f9-65b9-4f4e-85b6-3b0bdd960326" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.743069] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1046.743250] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1047.106990] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1047.107210] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1047.107343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.107554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.109059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.109059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.109059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.109059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.109059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.109059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.109059] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.463585] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664c49c8-8d39-49fa-b67a-7036d944867d in Status: SUCCESS [ 1047.464102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.464102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.464297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.464653] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.464782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.464870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.465096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.465218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.465340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.465439] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.610510] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.778146] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.778146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.778146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.778146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.790957] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1047.791897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.792992] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1047.827236] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.827460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.827510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.827743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.838728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.839475] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1047.839570] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1047.839642] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1047.919462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.919586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.919586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.919868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.921543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.921747] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1047.968139] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.072981] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.072981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.072981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.072981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.072981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.072981] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1048.112866] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.169723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.170059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.170059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.170234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.170551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.170953] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:49. [ 1048.171095] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'dbf33eac-b2a3-4597-bef7-45961c5c9915', '39d49db7-880a-475c-959f-8bf596c72350', '8ae9556d-2824-4426-9646-69904ca4036b', '1ca8f202-29e2-429e-9fd1-0f8cb9990f6f', '0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3', 'd32cda0b-8a2f-42b1-8b70-9028c276b777', '82006ff4-e51b-42b0-a24d-bbd2eef044f1', 'f3411048-5318-4245-bd13-ad8c65f4de91', 'b1379de6-944a-41ee-b7a5-1b4425bc546e', '336c99cf-6401-42f0-a311-bcd662eef8ca', 'e03b40fb-01ef-40a2-8d18-b763e5ce28be', '5dac161d-87bb-4f31-a632-3c3213ca7adf', 'd11ae3e7-68e0-48ab-9cf6-d1803117fc1f', '9cc4e90e-8be3-416a-9e0b-5aef0a7e1667', 'f44c5dff-d003-41a8-874e-8ad81c2de7ca', '4299363c-8eac-44c8-95f4-12c59a4c43bb', '8adf627f-6f53-4e8f-bb06-db2aedef22fc', '56b74809-473d-4b46-a128-e8953c39feab', 'e4620817-a8af-47ab-8dc5-45c9281feca7', '3291e19b-f819-4f27-bac2-5fd32a181ddc', '6b5dadcb-8f3a-482e-b14c-24a6ef163d88', 'ae0af2af-9718-4a7b-876d-92e1124cdbd2', '0dd4d842-afe8-4003-a8ee-07600ff1edfd', '02feb9e5-0f08-496b-8186-408b46050c5d', '4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd', 'e56f2582-99a0-4048-840f-b0950b64562f', 'd58a5975-db0d-4e76-84b4-0eaa1b1c8688', '49706196-d349-4818-ae7e-d6615560719a', '5e5af08c-4029-463c-937e-2ea7bf68d7d1', '5d415299-ca3d-4305-942b-69b3b58ccb49', '851d68f8-1229-406c-ac33-c91b60c34ee0', 'c1371be0-e403-4fc8-b7ba-48edcbdada5e', '7083382f-6e66-45d0-9fc4-efa15b381900', '078ba4a4-0e86-4b25-838d-1fc110729dbd', 'c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc', 'ac3c0a5a-197c-4c4c-a82b-9342302fe922', '2fb66ad5-69f7-466f-94b1-24f53af1b70c', '13c5346a-4114-4ee9-bda4-7f968a612f58', '4986f406-ffa8-458b-a142-64bc589ad53b', 'de120ad0-cbd8-47c5-85f0-73d798da60f8', 'e38df862-3877-4fbb-b2b8-8702550f272a', 'aa843f83-ade7-475f-9e86-d1f12b4e1f38', '082fc1a8-0a58-4162-926b-fe01957908a7', 'a5fd4ec2-d6c3-4894-bd80-751b7e6176d6', '0521b23b-9dcc-40b0-a1c4-32590b372bcd', 'a6dd9b03-d553-4b7a-b9f5-f9e3b715daba', '43a553ce-6692-41a3-ab44-fe5b38b80d7f', '0756d72c-9df8-4861-9190-090f401edeb6', 'd8285264-bd0f-4381-9dd8-8b3192b9b544'} {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1048.171214] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1048.196611] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.196875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.197040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.197396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.197560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.197723] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1048.197845] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1048.197961] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1048.331380] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.331380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.331670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.331863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.333345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.333757] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1048.333890] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1048.333995] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1048.334209] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1048.334209] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/49 resources of Type:Security Group Rules [ 1048.335668] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGH for action security_group_rules [ 1048.335668] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGH for action security_group_rules [ 1048.335668] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGH for action security_group_rules [ 1048.335668] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGH for action security_group_rules [ 1048.336267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGH for action security_group_rules [ 1048.336267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGH for action security_group_rules [ 1048.336267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGH for action security_group_rules [ 1048.336267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGH for action security_group_rules [ 1048.336267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGH for action security_group_rules [ 1048.336267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGH for action security_group_rules [ 1048.336267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGH for action security_group_rules [ 1048.336766] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGH for action security_group_rules [ 1048.336766] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGH for action security_group_rules [ 1048.336766] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGH for action security_group_rules [ 1048.336766] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGH for action security_group_rules [ 1048.336766] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGH for action security_group_rules [ 1048.337048] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGH for action security_group_rules [ 1048.337048] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGH for action security_group_rules [ 1048.337048] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGH for action security_group_rules [ 1048.337638] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGH for action security_group_rules [ 1048.337638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.472350] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 664c49c8-8d39-49fa-b67a-7036d944867d: rpc.has_security_group_logging(os_id): False [ 1048.493801] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.493967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.494068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.494308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.494406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.494658] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.494762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.494873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.494976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.495065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.495152] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 664c49c8-8d39-49fa-b67a-7036d944867d is going to be created. [ 1048.567506] env[65087]: INFO networking_nsxv3.common.synchronization [None req-9d5eee7d-1673-423a-8609-ae0b632c9af0 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_rules [ 1048.568735] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_rules [ 1048.569039] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGH for action security_group_rules [ 1048.569136] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae9556d-2824-4426-9646-69904ca4036b with Priority: HIGH for action security_group_rules [ 1048.569328] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 with Priority: HIGH for action security_group_rules [ 1048.569413] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca with Priority: HIGH for action security_group_rules [ 1048.569636] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc with Priority: HIGH for action security_group_rules [ 1048.569678] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGH for action security_group_rules [ 1048.569818] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56b74809-473d-4b46-a128-e8953c39feab with Priority: HIGH for action security_group_rules [ 1048.569981] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc with Priority: HIGH for action security_group_rules [ 1048.570104] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 with Priority: HIGH for action security_group_rules [ 1048.570257] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb with Priority: HIGH for action security_group_rules [ 1048.570787] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGH for action security_group_rules [ 1048.570955] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf with Priority: HIGH for action security_group_rules [ 1048.571121] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be with Priority: HIGH for action security_group_rules [ 1048.571264] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGH for action security_group_rules [ 1048.571403] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGH for action security_group_rules [ 1048.571545] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 with Priority: HIGH for action security_group_rules [ 1048.571808] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGH for action security_group_rules [ 1048.571808] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 with Priority: HIGH for action security_group_rules [ 1048.571969] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGH for action security_group_rules [ 1048.572124] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f with Priority: HIGH for action security_group_rules [ 1048.572610] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.572864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.572951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.573308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.573432] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.576049] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.576341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.576542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.576775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.576938] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.578257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ae9556d-2824-4426-9646-69904ca4036b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.578387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.578458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.578666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.578766] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ae9556d-2824-4426-9646-69904ca4036b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.579924] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.580057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.580486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.580486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.580486] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82006ff4-e51b-42b0-a24d-bbd2eef044f1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.581282] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.581433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.581602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.581602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.581682] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f44c5dff-d003-41a8-874e-8ad81c2de7ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.582409] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3291e19b-f819-4f27-bac2-5fd32a181ddc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.582557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.582595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.582775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.582810] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3291e19b-f819-4f27-bac2-5fd32a181ddc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.583684] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.583820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.583883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.584015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.584093] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.584849] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-56b74809-473d-4b46-a128-e8953c39feab taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.584917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.585018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.585141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.585217] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('56b74809-473d-4b46-a128-e8953c39feab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.585898] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.586039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.586214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.586382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.586472] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8adf627f-6f53-4e8f-bb06-db2aedef22fc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.587795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.587922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.587995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.588174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.588255] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9cc4e90e-8be3-416a-9e0b-5aef0a7e1667',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.589022] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4299363c-8eac-44c8-95f4-12c59a4c43bb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.589287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.589359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.589538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.589619] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4299363c-8eac-44c8-95f4-12c59a4c43bb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.590718] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.590849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.590932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.591176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.591277] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.593853] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5dac161d-87bb-4f31-a632-3c3213ca7adf taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.593965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.594048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.594209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.594316] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5dac161d-87bb-4f31-a632-3c3213ca7adf',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.595059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.595180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.595265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.595448] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.595530] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e03b40fb-01ef-40a2-8d18-b763e5ce28be',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.596334] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.596457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.596610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.596768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.596876] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.597674] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.597810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.597914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.598120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.598225] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.599069] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d32cda0b-8a2f-42b1-8b70-9028c276b777 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.599476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.599476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.599708] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.599807] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d32cda0b-8a2f-42b1-8b70-9028c276b777',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.600793] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.600921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.601010] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.601203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.601496] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.602047] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.602159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.602226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.602393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.602467] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.603151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.603261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.603326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.603475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.603548] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.604356] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.604494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.604545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.604708] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.604754] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ca8f202-29e2-429e-9fd1-0f8cb9990f6f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.606257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.606378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.606463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.606629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.606808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.614763] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.615082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.615173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.616248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.617234] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.617372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.617444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.617618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.617711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.617838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.617883] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.620896] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.621024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.621095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.621266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.621345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.621463] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1048.655184] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 664c49c8-8d39-49fa-b67a-7036d944867d in Status: IN_PROGRESS for 2s [ 1048.661370] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.661548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.661597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.662210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.665104] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.665104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.667542] env[65087]: INFO networking_nsxv3.common.synchronization [None req-f5435752-ee75-4e37-acac-c3f68e45ae82 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_rules [ 1048.667872] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_rules [ 1048.669412] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.669412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.675648] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.675786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.684973] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.685157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.685206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.685418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.685570] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.690551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.691297] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82006ff4-e51b-42b0-a24d-bbd2eef044f1 is going to be deleted. [ 1048.691822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.692057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.838918] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1048.862022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.862022] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ae9556d-2824-4426-9646-69904ca4036b is going to be deleted. [ 1048.862022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.862022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.903123] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.903340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.921155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.921155] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3291e19b-f819-4f27-bac2-5fd32a181ddc is going to be deleted. [ 1048.922181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.922314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.922401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.922513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82006ff4-e51b-42b0-a24d-bbd2eef044f1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.998279] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.998279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.998279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.998279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.998279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.998279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ae9556d-2824-4426-9646-69904ca4036b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.013666] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.013896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.013966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.014339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.014487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.014656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3291e19b-f819-4f27-bac2-5fd32a181ddc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.114698] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.114915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.114915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.115134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.115305] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.115410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.115474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.115841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.115841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.115841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.116045] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.119126] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.119291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.119335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.119507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.119665] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.119763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.119827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.119969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.120108] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.120213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.120326] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.126436] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.126596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.126647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.126829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.126988] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.127098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.127162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.127313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.127433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.127473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.127550] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.129979] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.130185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.130185] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.130377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.130472] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.130579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.130631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.130774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.130857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.130941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.131040] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.132630] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.132755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.132818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.132946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.133106] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.133923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.134014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.134493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.134615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.134713] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.135505] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.137638] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.137755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.137829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.138029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.138190] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.138305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.138369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.138543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.138631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.138717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.138863] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.138955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.139034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.139180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.139317] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.139408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.139467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.139599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.139674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.139754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.139840] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.164208] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.164435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.164435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.164630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.166962] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.167093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.183085] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.183085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.185449] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.185449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.186246] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.186424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.187101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.187201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.192466] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.193140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.193806] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.193905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.204518] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.204654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.205084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.205189] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f44c5dff-d003-41a8-874e-8ad81c2de7ca is going to be deleted. [ 1049.206681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.206681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.206681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.206681] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 already deleted. [ 1049.206681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.208178] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.208306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.208388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.208571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.209493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.209831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.209831] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.211683] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.211787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.212188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.212294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.238297] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1049.238885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.238997] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5dac161d-87bb-4f31-a632-3c3213ca7adf is going to be deleted. [ 1049.240236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.240459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.302701] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.302840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.312876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.312876] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3 is going to be deleted. [ 1049.314399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.314399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.354227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.354401] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8adf627f-6f53-4e8f-bb06-db2aedef22fc is going to be deleted. [ 1049.355974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.356283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.362085] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.362261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.430912] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.431146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.436061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.436243] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4299363c-8eac-44c8-95f4-12c59a4c43bb is going to be deleted. [ 1049.437173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.437375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.462108] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.462325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.467280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.467582] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 56b74809-473d-4b46-a128-e8953c39feab is going to be deleted. [ 1049.468476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.468700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.533966] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.534463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.535409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.535547] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ca8f202-29e2-429e-9fd1-0f8cb9990f6f is going to be deleted. [ 1049.536807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.537049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.614403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.614571] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e03b40fb-01ef-40a2-8d18-b763e5ce28be is going to be deleted. [ 1049.615587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.615831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.624821] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.625767] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.642419] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.644421] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.646324] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.649521] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbf33eac-b2a3-4597-bef7-45961c5c9915: rpc.has_security_group_logging(os_id): False [ 1049.666195] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.666415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.667637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.667835] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be deleted. [ 1049.669072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.669355] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.681595] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.681805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.696345] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.696564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.722080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.722262] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d32cda0b-8a2f-42b1-8b70-9028c276b777 is going to be deleted. [ 1049.723190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.723408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.744103] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.744103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.776530] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.776757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.796515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.796681] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9cc4e90e-8be3-416a-9e0b-5aef0a7e1667 is going to be deleted. [ 1049.797844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.798091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.798209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.798361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f44c5dff-d003-41a8-874e-8ad81c2de7ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.798545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.798737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.798831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.798961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5dac161d-87bb-4f31-a632-3c3213ca7adf" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.799573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.799763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.799879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.799990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0e3c61-19aa-4ea0-95f7-1ae02f1724f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.800143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.800292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.800371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.800475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8adf627f-6f53-4e8f-bb06-db2aedef22fc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.800599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.800738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.800813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.800918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4299363c-8eac-44c8-95f4-12c59a4c43bb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.801130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.801309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.801428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.801578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ca8f202-29e2-429e-9fd1-0f8cb9990f6f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.801901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.802065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.889893] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.890226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.898247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.898756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.898999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.899179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.899592] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.899714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.900023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.900222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.900351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.900629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.900788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.901175] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.901342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.901471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.901736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.901889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.902062] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be updated. [ 1049.903677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.903942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.904080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.904335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-56b74809-473d-4b46-a128-e8953c39feab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.904552] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.904783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.904900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.905069] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 already deleted. [ 1049.905224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.905498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.905744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.905872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.906062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e03b40fb-01ef-40a2-8d18-b763e5ce28be" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.906251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.906491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.906665] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.906767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.937125] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.937307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.937412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.937608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.937765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.937833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d32cda0b-8a2f-42b1-8b70-9028c276b777" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.011755] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.011971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.012095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.012412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.012521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.012755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9cc4e90e-8be3-416a-9e0b-5aef0a7e1667" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.128674] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3411048-5318-4245-bd13-ad8c65f4de91: rpc.has_security_group_logging(os_id): False [ 1050.130093] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d11ae3e7-68e0-48ab-9cf6-d1803117fc1f: rpc.has_security_group_logging(os_id): False [ 1050.132667] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.132978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.132978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.133194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.133416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.147471] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39d49db7-880a-475c-959f-8bf596c72350: rpc.has_security_group_logging(os_id): False [ 1050.148901] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4620817-a8af-47ab-8dc5-45c9281feca7: rpc.has_security_group_logging(os_id): False [ 1050.154202] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1379de6-944a-41ee-b7a5-1b4425bc546e: rpc.has_security_group_logging(os_id): False [ 1050.155982] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.156463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.156463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.156463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.159101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.159303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.167537] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: IN_PROGRESS for 2s [ 1050.193355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.193624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.194564] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.194788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.204401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.204695] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.204802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.204892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.205092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.205306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.205474] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be updated. [ 1050.206954] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.207421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.209242] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.209370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.252070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.252564] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.252761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.252761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.253367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.253367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.253367] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1050.255585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.255585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.313756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.315913] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.315913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.315913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.315913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.315913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.315913] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d49db7-880a-475c-959f-8bf596c72350 is going to be updated. [ 1050.317438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.317696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.350085] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.350085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.358926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.359746] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.359746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.359746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.359746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.359746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.360155] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 is going to be updated. [ 1050.361116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.361294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.387337] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.387627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.397423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.397746] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.397847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.397919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.398154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.398254] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.398346] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e is going to be updated. [ 1050.402230] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.402911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.402911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.404269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.404503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.404697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.420853] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.420853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.420853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.420853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.420853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.444944] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1050.446622] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: IN_PROGRESS for 2s [ 1050.456488] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d49db7-880a-475c-959f-8bf596c72350 in Status: IN_PROGRESS for 2s [ 1050.508760] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.508760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.508760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.509528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.509528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.531670] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.531670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.531670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.531670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.532176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.555527] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4620817-a8af-47ab-8dc5-45c9281feca7 in Status: IN_PROGRESS for 2s [ 1050.556680] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1050.557127] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1379de6-944a-41ee-b7a5-1b4425bc546e in Status: IN_PROGRESS for 2s [ 1050.669822] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 664c49c8-8d39-49fa-b67a-7036d944867d in Status: SUCCESS [ 1050.669822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.851355] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1050.851672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.852361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.852963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.853249] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.853558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.853917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.854328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.854572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.855172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.856181] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.358894] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.359209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.359209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.359417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.359622] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.359765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.359831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.360030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.360172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.360286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.360578] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.360690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.360753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.360913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.361073] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.361182] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.361243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.361390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.361458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.361547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.362189] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.866203] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4986f406-ffa8-458b-a142-64bc589ad53b: rpc.has_security_group_logging(os_id): False [ 1051.884577] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.884984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.885140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.885407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.909994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.910160] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.910358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.910358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.911534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.911534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.911534] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.911534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.911534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.911534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.911534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.911534] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.911534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.911534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.912017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.912017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.912017] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1051.982078] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.982788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.982788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.982788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.982788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.997543] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1052.185047] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 1052.185047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.459294] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: SUCCESS [ 1052.459627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.460480] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1052.460660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.471737] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39d49db7-880a-475c-959f-8bf596c72350 in Status: SUCCESS [ 1052.472063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.573948] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1379de6-944a-41ee-b7a5-1b4425bc546e in Status: SUCCESS [ 1052.574332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.575247] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4620817-a8af-47ab-8dc5-45c9281feca7 in Status: SUCCESS [ 1052.575449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.668976] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1053.669339] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1053.821342] env[65087]: INFO networking_nsxv3.common.synchronization [req-b8fd3aeb-ff21-4e20-942d-9a0900b338fe req-bd164d8d-f6a1-470d-8fd6-5bb3908ba1c9 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_members [ 1053.822064] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGHEST for action security_group_members [ 1053.822423] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.822532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.822577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.822779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.822940] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.823068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.823137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.823260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.823322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.823419] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.013420] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1054.013658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.327532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.327726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.327776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.328084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.328189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.328406] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.328505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.328584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.328790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.328871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.328913] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 is going to be updated. [ 1054.360116] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.360340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.360340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.360544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.360699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.370315] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4620817-a8af-47ab-8dc5-45c9281feca7 in Status: IN_PROGRESS for 2s [ 1054.863909] env[65087]: INFO networking_nsxv3.common.synchronization [req-9878e73a-ad46-4d63-9bd5-5b271c2af394 req-aff032df-fae8-4bbb-ac46-ef7f601a7b2e tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1054.864507] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1054.864800] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.864979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.864979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.865624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.865832] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.865945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.866036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.866284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.866367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.866466] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.232764] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.232927] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.233101] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.233393] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.233674] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.233835] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.234029] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.234193] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.234368] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.234616] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.234677] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.234787] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.234940] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.235027] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.235366] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.235366] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.262652] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.262652] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1055.262652] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.263124] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.263124] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-4bffa0cb-56bf-4188-93e3-0760187ffc9c taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.263301] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-4bffa0cb-56bf-4188-93e3-0760187ffc9c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.263378] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-4bffa0cb-56bf-4188-93e3-0760187ffc9c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.263715] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-4bffa0cb-56bf-4188-93e3-0760187ffc9c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.263868] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bffa0cb-56bf-4188-93e3-0760187ffc9c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.369854] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.370042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.370107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.370390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.370390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.370584] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.370740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.370740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.371014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.371105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.371219] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 already deleted. [ 1055.371286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.768089] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.768536] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.768770] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.769070] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.769526] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.769611] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 4bffa0cb-56bf-4188-93e3-0760187ffc9c not found, creating... [ 1055.769887] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.770080] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.770202] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.770437] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.770577] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.770860] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.771024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.771140] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.771346] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.771480] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.771617] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 4bffa0cb-56bf-4188-93e3-0760187ffc9c is going to be created. [ 1055.792457] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.792679] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.792810] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.793113] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.793377] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.793570] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-4bffa0cb-56bf-4188-93e3-0760187ffc9c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.382411] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4620817-a8af-47ab-8dc5-45c9281feca7 in Status: SUCCESS [ 1056.382772] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 deletion is rescheduled due to dependency. [ 1056.382772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.535259] env[65087]: INFO networking_nsxv3.common.synchronization [req-9878e73a-ad46-4d63-9bd5-5b271c2af394 req-fe8c98e4-84f7-40c5-89d7-32619bbda1c3 service nova] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_rules [ 1056.535259] env[65087]: INFO networking_nsxv3.common.synchronization [req-9878e73a-ad46-4d63-9bd5-5b271c2af394 req-fe8c98e4-84f7-40c5-89d7-32619bbda1c3 service nova] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1056.535438] env[65087]: INFO networking_nsxv3.common.synchronization [req-9878e73a-ad46-4d63-9bd5-5b271c2af394 req-fe8c98e4-84f7-40c5-89d7-32619bbda1c3 service nova] Enqueued Resource ID: 4bffa0cb-56bf-4188-93e3-0760187ffc9c with Priority: HIGHEST for action port [ 1056.537873] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_rules [ 1056.537873] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1056.537873] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bffa0cb-56bf-4188-93e3-0760187ffc9c with Priority: HIGHEST for action port [ 1056.537873] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.537873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.537873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.537873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.537873] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.539905] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.540156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.540197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.540441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.540637] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.540851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.540972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.541161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.541276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.541484] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.542479] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bffa0cb-56bf-4188-93e3-0760187ffc9c taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.542618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bffa0cb-56bf-4188-93e3-0760187ffc9c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.542709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bffa0cb-56bf-4188-93e3-0760187ffc9c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.543220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bffa0cb-56bf-4188-93e3-0760187ffc9c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.543411] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bffa0cb-56bf-4188-93e3-0760187ffc9c',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.045899] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.046174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.046318] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.047382] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bffa0cb-56bf-4188-93e3-0760187ffc9c with status ACTIVE [ 1057.047771] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.047771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.047771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.047999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.048126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.048386] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.048501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.048602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.048775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.048873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.049589] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.049787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.049864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.050765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.050765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.050765] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bffa0cb-56bf-4188-93e3-0760187ffc9c is going to be updated. [ 1057.074120] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.074768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.074768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.074768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.074936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.075145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bffa0cb-56bf-4188-93e3-0760187ffc9c" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.553625] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.056054] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.056303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.056303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.056512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.056603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.056706] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 is going to be created. [ 1058.090950] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.091243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.091243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.091435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.091607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.106020] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: UNINITIALIZED for 2s [ 1060.120221] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: SUCCESS [ 1060.120631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.120631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.120762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.120951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.121083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.121149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.121305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.121385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.121471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.121563] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.624041] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.085482] env[65087]: INFO networking_nsxv3.common.synchronization [req-c9c00aea-44f2-4758-8808-ec377ff65bc6 req-5c4807fe-5013-488f-8b5d-e3d10b982d1a tempest-ImagesOneServerNegativeTestJSON-1111695184 tempest-ImagesOneServerNegativeTestJSON-1111695184-project-member] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1061.086139] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1061.086678] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.086678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.086784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.086971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.089279] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.089502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.089502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.089681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.089773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.089893] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.128195] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50e018c5-8d62-4c55-9680-f69bf86acab6: rpc.has_security_group_logging(os_id): False [ 1061.150960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.152299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.152421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.152716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.152841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.153261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.153504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.153504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.153649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.153724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.153848] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 is going to be created. [ 1061.233968] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.233968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.234389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.234389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.234554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.249733] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: IN_PROGRESS for 2s [ 1061.465498] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.465729] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.465861] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.466187] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.466610] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.466834] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.467013] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.467312] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.467523] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.467787] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.467946] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.468131] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.468281] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.468459] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.468636] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.468842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.488291] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.488481] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1061.488624] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.488897] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-336" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.489318] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-1b000725-4a51-4fbc-aa22-460f7023af91 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.489535] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-1b000725-4a51-4fbc-aa22-460f7023af91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.489624] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-1b000725-4a51-4fbc-aa22-460f7023af91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.489930] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-1b000725-4a51-4fbc-aa22-460f7023af91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.490089] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b000725-4a51-4fbc-aa22-460f7023af91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.592054] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.592054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.592054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.592453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.592453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.592453] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.592585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.592585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.592740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.592817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.592901] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be deleted. [ 1061.633673] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.633990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.633990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.634210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.634313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.634445] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.992655] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.992897] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.993035] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.993323] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.993476] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.993669] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 1b000725-4a51-4fbc-aa22-460f7023af91 not found, creating... [ 1061.993897] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.994079] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.994194] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.994441] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.994582] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.994862] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.995100] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.995273] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.995493] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.995630] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.995769] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 1b000725-4a51-4fbc-aa22-460f7023af91 is going to be created. [ 1062.019070] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.019289] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.019431] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.019710] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.019939] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.020182] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-1b000725-4a51-4fbc-aa22-460f7023af91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.790061] env[65087]: INFO networking_nsxv3.common.synchronization [req-c9c00aea-44f2-4758-8808-ec377ff65bc6 req-a4df7cc6-803b-4a5d-9641-98696723eea2 service nova] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_rules [ 1062.790061] env[65087]: INFO networking_nsxv3.common.synchronization [req-c9c00aea-44f2-4758-8808-ec377ff65bc6 req-a4df7cc6-803b-4a5d-9641-98696723eea2 service nova] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1062.790061] env[65087]: INFO networking_nsxv3.common.synchronization [req-c9c00aea-44f2-4758-8808-ec377ff65bc6 req-a4df7cc6-803b-4a5d-9641-98696723eea2 service nova] Enqueued Resource ID: 1b000725-4a51-4fbc-aa22-460f7023af91 with Priority: HIGHEST for action port [ 1062.790061] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_rules [ 1062.790061] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1062.790061] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b000725-4a51-4fbc-aa22-460f7023af91 with Priority: HIGHEST for action port [ 1062.790061] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.790061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.790061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.792627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.792852] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.795222] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.795467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.795873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.796163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.799133] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.799133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.799133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.799133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.799133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.799133] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.799771] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b000725-4a51-4fbc-aa22-460f7023af91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.800697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b000725-4a51-4fbc-aa22-460f7023af91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.800697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b000725-4a51-4fbc-aa22-460f7023af91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.800697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b000725-4a51-4fbc-aa22-460f7023af91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.800697] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b000725-4a51-4fbc-aa22-460f7023af91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.267376] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: SUCCESS [ 1063.267677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.296484] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.296712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.300650] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.307443] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b000725-4a51-4fbc-aa22-460f7023af91 with status ACTIVE [ 1063.307443] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.307443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.307975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.307975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.307975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.308508] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.308508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.308508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.308508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.308508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.309506] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.309506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.309506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.309506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.309506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.309506] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b000725-4a51-4fbc-aa22-460f7023af91 is going to be updated. [ 1063.335273] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.335524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.335524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.335716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.335864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.336570] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b000725-4a51-4fbc-aa22-460f7023af91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.803892] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.307083] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.307315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.307315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.307569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.307666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.307767] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be created. [ 1064.362242] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.362596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.362728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.362922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.363206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.380284] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: UNINITIALIZED for 2s [ 1066.395026] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 1066.395332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.395332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.395537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.395737] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.395847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.397119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.397119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.397119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.397119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.397119] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.901355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.901579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.901650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.901876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.902092] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.902211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.902317] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.902498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.902593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.902685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.902839] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.902969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.903045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.903236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.903379] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.903474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.903535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.903677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.903744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.903828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.903918] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.406152] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 336c99cf-6401-42f0-a311-bcd662eef8ca: rpc.has_security_group_logging(os_id): False [ 1067.424430] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.424611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.424686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.424976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.425132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.425405] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.425517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.425586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.425765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.425849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.426072] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.426198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.426271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.426471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.426604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.426756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.426874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.426936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.427112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.427205] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.427307] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be created. [ 1067.485515] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.485711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.485796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.486082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.486326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.503827] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: IN_PROGRESS for 2s [ 1067.790271] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1067.790500] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1068.356994] env[65087]: INFO networking_nsxv3.common.synchronization [req-d633efe2-dd2a-4140-a8a8-3d96228f9a97 req-b22dc195-8585-407b-9a93-a8c2cf0932b9 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 1068.356994] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 1068.356994] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.356994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.356994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.356994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.356994] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.356994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.356994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.356994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.356994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.356994] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.709647] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.710068] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.710068] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.710275] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.711017] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.711262] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.711411] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.711639] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.711783] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.711992] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.712119] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.712283] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.712374] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.712487] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.712593] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.712730] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.735291] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.735291] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.735291] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.735448] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.735823] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-8a41695b-069a-4047-bfee-40ce392af4f3 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.735989] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.736127] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.737568] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.737568] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a41695b-069a-4047-bfee-40ce392af4f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.860732] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.860900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.861000] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.861222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.861332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.861467] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.861571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.861632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.861778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.861862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.861938] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be deleted. [ 1068.893352] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.893572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.893620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.893830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.893923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.894041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.242304] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.242621] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.242756] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.243054] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.243279] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.243477] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 8a41695b-069a-4047-bfee-40ce392af4f3 not found, creating... [ 1069.243750] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.243951] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.244147] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.244415] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.244587] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.244987] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.245175] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.245294] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.245552] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.245754] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.245906] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 8a41695b-069a-4047-bfee-40ce392af4f3 is going to be created. [ 1069.267444] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.267717] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.267862] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.268292] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.268520] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.268745] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.521900] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 1069.522169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.993222] env[65087]: INFO networking_nsxv3.common.synchronization [req-d633efe2-dd2a-4140-a8a8-3d96228f9a97 req-0f21bd40-e1f9-4787-b0b5-e0bce3b935db service nova] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_rules [ 1069.993625] env[65087]: INFO networking_nsxv3.common.synchronization [req-d633efe2-dd2a-4140-a8a8-3d96228f9a97 req-0f21bd40-e1f9-4787-b0b5-e0bce3b935db service nova] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 1069.993625] env[65087]: INFO networking_nsxv3.common.synchronization [req-d633efe2-dd2a-4140-a8a8-3d96228f9a97 req-0f21bd40-e1f9-4787-b0b5-e0bce3b935db service nova] Enqueued Resource ID: 8a41695b-069a-4047-bfee-40ce392af4f3 with Priority: HIGHEST for action port [ 1069.994533] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_rules [ 1069.994533] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 1069.994533] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a41695b-069a-4047-bfee-40ce392af4f3 with Priority: HIGHEST for action port [ 1069.994824] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.994942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.995048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.995306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.995396] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.996797] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.996797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.996797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.997110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.997203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.997372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.998062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.998306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.998445] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.998526] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.000619] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a41695b-069a-4047-bfee-40ce392af4f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.000726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.000781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.001160] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.001160] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a41695b-069a-4047-bfee-40ce392af4f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.501354] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.502866] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a41695b-069a-4047-bfee-40ce392af4f3 with status ACTIVE [ 1070.502866] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.502866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.503082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.503165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.503243] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.503426] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.503568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.504692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.504692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.504692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.504692] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.504692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.504692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.504692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.504692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.504692] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a41695b-069a-4047-bfee-40ce392af4f3 is going to be updated. [ 1070.506076] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.506076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.530297] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.530545] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.530613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.530809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.530945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.531127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.768510] env[65087]: INFO networking_nsxv3.common.synchronization [req-b38e4f1e-4cd7-4683-8d79-d004a210edd3 req-ae0e02b1-24a1-4bae-abbc-e2b36137306e tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1070.769051] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1070.770574] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.770829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.770829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.770960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.771136] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.771342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.771342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.771485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.771538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.771647] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.008045] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.102735] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.103232] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.103232] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.103612] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.103930] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.104138] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.104305] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.104612] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.104791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.105062] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.105188] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.105334] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.105465] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.105614] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.105755] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.105983] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.136401] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.136651] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.136725] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.136903] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.137262] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-6b88161c-43be-451a-ab7f-9b15009ba0d1 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.137470] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-6b88161c-43be-451a-ab7f-9b15009ba0d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.137615] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-6b88161c-43be-451a-ab7f-9b15009ba0d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.137986] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-6b88161c-43be-451a-ab7f-9b15009ba0d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.138154] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b88161c-43be-451a-ab7f-9b15009ba0d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.273907] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.509521] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.509693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.509693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.509906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.510012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.510113] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be created. [ 1071.534329] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.534547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.534672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.534880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.535057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.543803] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: UNINITIALIZED for 2s [ 1071.640555] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.640787] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.640910] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.641243] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.641458] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.641547] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 6b88161c-43be-451a-ab7f-9b15009ba0d1 not found, creating... [ 1071.641810] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.641966] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.642092] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.642313] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.642521] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.642820] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.643064] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.643231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.643446] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.643580] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.643718] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 6b88161c-43be-451a-ab7f-9b15009ba0d1 is going to be created. [ 1071.663130] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.663339] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.663453] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.663679] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.663897] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.664131] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-6b88161c-43be-451a-ab7f-9b15009ba0d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.777207] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.280071] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.280402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.280402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.280603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.280728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.280837] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 is going to be updated. [ 1072.315046] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.315195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.315195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.315409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.315563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.325625] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: IN_PROGRESS for 2s [ 1072.383819] env[65087]: INFO networking_nsxv3.common.synchronization [req-b38e4f1e-4cd7-4683-8d79-d004a210edd3 req-3f4881ad-cde6-4cc2-8e50-95042de4e730 service nova] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_rules [ 1072.384014] env[65087]: INFO networking_nsxv3.common.synchronization [req-b38e4f1e-4cd7-4683-8d79-d004a210edd3 req-3f4881ad-cde6-4cc2-8e50-95042de4e730 service nova] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1072.384159] env[65087]: INFO networking_nsxv3.common.synchronization [req-b38e4f1e-4cd7-4683-8d79-d004a210edd3 req-3f4881ad-cde6-4cc2-8e50-95042de4e730 service nova] Enqueued Resource ID: 6b88161c-43be-451a-ab7f-9b15009ba0d1 with Priority: HIGHEST for action port [ 1072.384938] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_rules [ 1072.385233] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1072.385296] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b88161c-43be-451a-ab7f-9b15009ba0d1 with Priority: HIGHEST for action port [ 1072.386431] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.386431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.386431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.386431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.386431] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.387306] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.387403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.387628] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b88161c-43be-451a-ab7f-9b15009ba0d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.387790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b88161c-43be-451a-ab7f-9b15009ba0d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.387870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b88161c-43be-451a-ab7f-9b15009ba0d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.388068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b88161c-43be-451a-ab7f-9b15009ba0d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.388149] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b88161c-43be-451a-ab7f-9b15009ba0d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.890080] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.890222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.890413] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b88161c-43be-451a-ab7f-9b15009ba0d1 with status ACTIVE [ 1072.890583] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.890689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.890776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.891021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.891115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.891287] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.891385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.891449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.891601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.891675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.891854] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.891948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.892013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.892266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.892384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.892494] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b88161c-43be-451a-ab7f-9b15009ba0d1 is going to be updated. [ 1072.915593] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.915593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.915826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.916043] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.916109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.916213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b88161c-43be-451a-ab7f-9b15009ba0d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.533818] env[65087]: INFO networking_nsxv3.common.synchronization [req-bc8b3fcf-0099-43ba-a5f1-13fdbaa8abe2 req-427d6eb0-1d0e-4f6c-962e-f32e1535fb62 tempest-ImagesOneServerNegativeTestJSON-1111695184 tempest-ImagesOneServerNegativeTestJSON-1111695184-project-member] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1073.536036] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGHEST for action security_group_members [ 1073.536036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.536036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.536036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.536036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.536036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.536036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.536036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.536036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.536036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.536036] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.556599] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: SUCCESS [ 1073.556874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.557991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.557991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.557991] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.557991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.557991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.557991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.557991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.558393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.558393] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.039061] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.039061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.039061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.039367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.039367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.039485] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.039574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.039632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.040120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.040120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.040120] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be updated. [ 1074.060990] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.061239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.061298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.061534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.061713] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.061821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.061886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.062058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.062147] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.062259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.062413] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.062507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.062569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.062709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.062845] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.062953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.063012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.063140] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.063214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.063296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.063386] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.072458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.072652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.072717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.072906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.073078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.084590] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: IN_PROGRESS for 2s [ 1074.338774] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: SUCCESS [ 1074.339067] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.339268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.339558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.339912] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.340101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.340180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.340403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.340538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.340713] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.565533] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0cdd684c-5a6e-4834-b6e5-a34e0caee842: rpc.has_security_group_logging(os_id): False [ 1074.585234] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.585418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.585469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.585662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.585874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.586107] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.586214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.586376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.586439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.586557] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.586731] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.586929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.586929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.587033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.587105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.587291] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.587382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.587447] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.587614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.587686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.587772] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be created. [ 1074.651633] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.651875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.651995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.652235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.652440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.665776] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: IN_PROGRESS for 2s [ 1074.843572] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.348419] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.738617] env[65087]: INFO networking_nsxv3.common.synchronization [req-fb5bbe34-c329-4a81-af0d-311c04f1e442 req-7269233d-8506-4fe8-a1ad-d6c6b66e7736 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1075.739301] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1075.739719] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.739820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.739868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.740097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.740275] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.740381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.740443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.740591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.740677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.740772] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.851948] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.852153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.852153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.852367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.852430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.852581] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 is going to be updated. [ 1075.883593] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.883796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.883796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.884053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.884199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.893951] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: IN_PROGRESS for 2s [ 1076.095677] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 336c99cf-6401-42f0-a311-bcd662eef8ca in Status: SUCCESS [ 1076.095977] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca deletion is rescheduled due to dependency. [ 1076.096177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.243310] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.243582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.243668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.243912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.268916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.269312] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.269387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.269467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.269784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.269784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.269894] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1076.311035] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.311295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.311359] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.311524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.311673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.320801] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1076.681513] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: SUCCESS [ 1076.681745] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.905457] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: SUCCESS [ 1077.905716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.905889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.906226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.906425] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.906549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.906640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.906808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.906881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.906988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.907102] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.335562] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1078.335562] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 1078.335562] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.409752] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.912566] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50e018c5-8d62-4c55-9680-f69bf86acab6: rpc.has_security_group_logging(os_id): False [ 1078.933971] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.933971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.933971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.933971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.934477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.934477] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.934477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.934477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.935204] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.935204] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.935204] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 is going to be updated. [ 1079.016556] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.016556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.016556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.016556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.016556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.041086] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: IN_PROGRESS for 2s [ 1080.680938] env[65087]: INFO networking_nsxv3.common.synchronization [req-79689c72-06fe-45ba-9d4c-8848fa3e913e req-e8ffa2c0-2e6f-4d28-90fe-7240c5401083 tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_members [ 1080.681873] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGHEST for action security_group_members [ 1080.682662] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.682901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.683040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.683400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.683756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.684222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.684222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.684855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.684855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.684958] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.722509] env[65087]: INFO networking_nsxv3.common.synchronization [req-6eaeffe2-ac7e-4735-9cf3-3f8d04ea031b req-1f51c153-a0c0-46a2-9302-cbeecad908bf tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1080.723630] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1080.724113] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.724270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.724347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.724510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.724672] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.724791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.724860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.724978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.725084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.725173] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.061325] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: SUCCESS [ 1081.061811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.151037] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c27701a-9ecf-4120-8ef3-d043e56b4d9c req-e09c2406-baf4-4974-9606-a54bf4a90984 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 1081.151733] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGHEST for action security_group_members [ 1081.152157] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.152294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.152956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.152956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.153095] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.153152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.153260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.153374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.153465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.153566] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.188678] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.188678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.188678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.189049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.189200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.189411] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.189553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.189629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.189836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.189948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.190068] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e is going to be updated. [ 1081.202525] env[65087]: INFO networking_nsxv3.common.synchronization [req-6c27701a-9ecf-4120-8ef3-d043e56b4d9c req-e09c2406-baf4-4974-9606-a54bf4a90984 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: 8a41695b-069a-4047-bfee-40ce392af4f3 with Priority: HIGHEST for action port [ 1081.203153] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a41695b-069a-4047-bfee-40ce392af4f3 with Priority: HIGHEST for action port [ 1081.203496] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a41695b-069a-4047-bfee-40ce392af4f3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.203703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.203703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.203935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.203985] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a41695b-069a-4047-bfee-40ce392af4f3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.219937] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.220189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.220289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.220482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.220627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.228112] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.228513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.228513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.228701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.228737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.229334] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.229334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.229334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.229334] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.229593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.229593] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1081.231748] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1379de6-944a-41ee-b7a5-1b4425bc546e in Status: IN_PROGRESS for 2s [ 1081.267258] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.267506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.267584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.267837] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.268046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.279476] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1081.656215] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.659091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.659091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.659091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.659091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.659091] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.659091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.659091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.659091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.659091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.659091] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be updated. [ 1081.695045] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.695421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.695421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.695550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.695637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.706480] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a41695b-069a-4047-bfee-40ce392af4f3 with status ACTIVE [ 1081.706773] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.706920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.706990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.707250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.707346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.707532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.707652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.707755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.708150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.708150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.708912] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.709076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.709153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.709276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.709509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.709509] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a41695b-069a-4047-bfee-40ce392af4f3 is going to be updated. [ 1081.713212] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: IN_PROGRESS for 2s [ 1081.742166] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.742449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.742449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.742620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.742738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.743077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a41695b-069a-4047-bfee-40ce392af4f3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.439932] env[65087]: INFO networking_nsxv3.common.synchronization [None req-e746c400-79a4-4648-a0e3-fab0c298d0b1 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1082.440568] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1082.440895] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.443870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.443870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.443870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.443870] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.443870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.443870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.443870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.443870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.443870] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.750414] env[65087]: INFO networking_nsxv3.common.synchronization [req-2e597770-bdfd-498d-a10f-106a0760da9f req-ad70d121-8a25-4d07-af31-0acf8e3608a7 tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1082.750987] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1082.751470] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.751612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.752110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.752347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.752512] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.752618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.752699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.752856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.752952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.753120] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.944666] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.945266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.945266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.945434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.973538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.973730] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.973851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.973917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.974217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.974321] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.974420] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1083.004956] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.005184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.005184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.005693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.005903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.020419] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1083.221321] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.221602] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.221744] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.222279] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.222670] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.223011] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.223176] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.223552] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.224592] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.224592] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.224592] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.224592] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.224592] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.224931] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.224931] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.225121] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.243620] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1379de6-944a-41ee-b7a5-1b4425bc546e in Status: SUCCESS [ 1083.243841] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e deletion is rescheduled due to dependency. [ 1083.244210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.249163] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.249163] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1083.249163] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.249163] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-314" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.249163] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-8d9e8380-828d-4365-8d17-630832f5d57e taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.249655] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-8d9e8380-828d-4365-8d17-630832f5d57e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.249655] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-8d9e8380-828d-4365-8d17-630832f5d57e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.249996] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-8d9e8380-828d-4365-8d17-630832f5d57e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.249996] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d9e8380-828d-4365-8d17-630832f5d57e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.255043] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.255260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.255260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.255529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.255722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.255946] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.256109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.256201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.256438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.256588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.256709] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1083.292242] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.292449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.292588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.292972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.293587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.296993] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1083.296993] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1083.296993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.304428] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1083.724384] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 in Status: SUCCESS [ 1083.724384] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 deletion is rescheduled due to dependency. [ 1083.724384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.753456] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.753456] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.753915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.753915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.754089] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.754295] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 8d9e8380-828d-4365-8d17-630832f5d57e not found, creating... [ 1083.754688] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.754881] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.755031] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.755316] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.755542] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.755862] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.756069] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.756257] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.756508] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.756698] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.756888] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 8d9e8380-828d-4365-8d17-630832f5d57e is going to be created. [ 1083.776204] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.776457] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.776717] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.777057] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.777340] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.777670] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-8d9e8380-828d-4365-8d17-630832f5d57e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.417901] env[65087]: INFO networking_nsxv3.common.synchronization [None req-8d9b06b6-8a08-4fa2-a26d-23983c7cf501 None None] Enqueued Resource ID: 00f30323-e6a6-4f5d-9fc2-010adb855ef1 with Priority: HIGHEST for action port [ 1084.418496] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f30323-e6a6-4f5d-9fc2-010adb855ef1 with Priority: HIGHEST for action port [ 1084.418827] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-00f30323-e6a6-4f5d-9fc2-010adb855ef1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.418976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00f30323-e6a6-4f5d-9fc2-010adb855ef1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.419260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00f30323-e6a6-4f5d-9fc2-010adb855ef1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.419882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00f30323-e6a6-4f5d-9fc2-010adb855ef1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.419882] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00f30323-e6a6-4f5d-9fc2-010adb855ef1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.508024] env[65087]: INFO networking_nsxv3.common.synchronization [req-2e597770-bdfd-498d-a10f-106a0760da9f req-8a0353fb-a13a-4851-acfc-299f8d7d9f0e service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 1084.508024] env[65087]: INFO networking_nsxv3.common.synchronization [req-2e597770-bdfd-498d-a10f-106a0760da9f req-8a0353fb-a13a-4851-acfc-299f8d7d9f0e service nova] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1084.508024] env[65087]: INFO networking_nsxv3.common.synchronization [req-2e597770-bdfd-498d-a10f-106a0760da9f req-8a0353fb-a13a-4851-acfc-299f8d7d9f0e service nova] Enqueued Resource ID: 8d9e8380-828d-4365-8d17-630832f5d57e with Priority: HIGHEST for action port [ 1084.508024] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_rules [ 1084.508024] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1084.508024] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d9e8380-828d-4365-8d17-630832f5d57e with Priority: HIGHEST for action port [ 1084.508024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.508024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.508024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.508927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.509173] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.510474] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.510769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.511775] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d9e8380-828d-4365-8d17-630832f5d57e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.511775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d9e8380-828d-4365-8d17-630832f5d57e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.511775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d9e8380-828d-4365-8d17-630832f5d57e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.511775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d9e8380-828d-4365-8d17-630832f5d57e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.511775] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d9e8380-828d-4365-8d17-630832f5d57e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.922882] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00f30323-e6a6-4f5d-9fc2-010adb855ef1 [ 1084.923190] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.923315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.923381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.923608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.923703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.924312] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00f30323-e6a6-4f5d-9fc2-010adb855ef1 already deleted. [ 1084.924312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00f30323-e6a6-4f5d-9fc2-010adb855ef1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.013395] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.013561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.015457] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d9e8380-828d-4365-8d17-630832f5d57e with status ACTIVE [ 1085.017432] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.017432] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.017432] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.017432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.018333] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d9e8380-828d-4365-8d17-630832f5d57e is going to be updated. [ 1085.033417] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1085.033608] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd deletion is rescheduled due to dependency. [ 1085.033684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.046726] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.046726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.046726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.046726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.046726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.046726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d9e8380-828d-4365-8d17-630832f5d57e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.314540] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1085.314813] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 1085.314889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.315791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.315791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.315791] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.315791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.315791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.316250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.316250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.316250] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.818874] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.320585] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.400740] env[65087]: INFO networking_nsxv3.common.synchronization [None req-202709af-b724-4ca8-9d75-c4f0825c1522 None None] Enqueued Resource ID: 742f2814-3e79-4e00-91d2-c3ed2c0ead60 with Priority: HIGHEST for action port [ 1086.401370] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 742f2814-3e79-4e00-91d2-c3ed2c0ead60 with Priority: HIGHEST for action port [ 1086.401723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-742f2814-3e79-4e00-91d2-c3ed2c0ead60 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.401963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-742f2814-3e79-4e00-91d2-c3ed2c0ead60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.401963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-742f2814-3e79-4e00-91d2-c3ed2c0ead60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.402823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-742f2814-3e79-4e00-91d2-c3ed2c0ead60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.402960] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('742f2814-3e79-4e00-91d2-c3ed2c0ead60',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.823544] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.827943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.827943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.827943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.827943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.827943] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1086.872063] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.872155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.872310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.872544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.872715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.887190] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1086.906439] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 742f2814-3e79-4e00-91d2-c3ed2c0ead60 [ 1086.906439] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.906439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.906439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.906832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.906832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.906911] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:742f2814-3e79-4e00-91d2-c3ed2c0ead60 already deleted. [ 1086.906997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-742f2814-3e79-4e00-91d2-c3ed2c0ead60" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.899699] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1088.899942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.900121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.900339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.900526] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.900645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.900712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.900860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.900942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.901037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.901129] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.408081] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.408081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.408081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.408081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.408293] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.408293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.408375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.408458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.408575] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.408628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.409014] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.409014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.409014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.409173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.409271] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.409360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.409417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.409551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.409622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.409700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.409789] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.710685] env[65087]: INFO networking_nsxv3.common.synchronization [req-a0618cad-23b5-4a81-91d6-3409daeb97cb req-73e33d03-57f5-4cb3-9c10-185c75ca1a6c tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1089.710685] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1089.710952] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.711090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.711366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.711366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.711497] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.711595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.711657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.711818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.711911] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.712011] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.912673] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e5af08c-4029-463c-937e-2ea7bf68d7d1: rpc.has_security_group_logging(os_id): False [ 1089.934442] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.934605] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.934677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.934950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.935063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.935292] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.935396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.935459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.935615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.935691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.935859] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.935952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.936021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.936159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.936231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.936430] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.936523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.936574] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.936760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.936845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.936936] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1090.004628] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.004843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.004932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.005120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.005268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.013700] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.014665] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.014665] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.014665] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.014665] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.015019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.015059] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.015388] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.015602] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.016977] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1090.016977] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.016977] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.017380] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.017380] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1090.017380] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.017380] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.022326] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1090.038496] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.038496] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1090.038697] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.038781] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.039191] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-04eb8c84-ca70-42e0-81ce-f392d069b63a taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.039403] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-04eb8c84-ca70-42e0-81ce-f392d069b63a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.039552] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-04eb8c84-ca70-42e0-81ce-f392d069b63a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.039812] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-04eb8c84-ca70-42e0-81ce-f392d069b63a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.040190] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04eb8c84-ca70-42e0-81ce-f392d069b63a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.214921] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.214921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.214921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.215242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.215242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.215315] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.215407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.215471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.215619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.215695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.215805] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1090.260156] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.260435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.260435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.260622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.260790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.272963] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1090.543450] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.543612] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.543727] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.544050] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.544513] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.544513] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 04eb8c84-ca70-42e0-81ce-f392d069b63a not found, creating... [ 1090.545045] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.545045] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.545045] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.545258] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.545326] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.545644] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.546274] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.546274] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.546274] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.546426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.546477] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 04eb8c84-ca70-42e0-81ce-f392d069b63a is going to be created. [ 1090.570578] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.570885] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.571096] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.571446] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.571748] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.572054] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-04eb8c84-ca70-42e0-81ce-f392d069b63a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.302875] env[65087]: INFO networking_nsxv3.common.synchronization [req-a0618cad-23b5-4a81-91d6-3409daeb97cb req-0d6d1c37-808e-4eb4-be20-a1f4b19df9ee service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 1091.303200] env[65087]: INFO networking_nsxv3.common.synchronization [req-a0618cad-23b5-4a81-91d6-3409daeb97cb req-0d6d1c37-808e-4eb4-be20-a1f4b19df9ee service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1091.303242] env[65087]: INFO networking_nsxv3.common.synchronization [req-a0618cad-23b5-4a81-91d6-3409daeb97cb req-0d6d1c37-808e-4eb4-be20-a1f4b19df9ee service nova] Enqueued Resource ID: 04eb8c84-ca70-42e0-81ce-f392d069b63a with Priority: HIGHEST for action port [ 1091.303809] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 1091.304014] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1091.304073] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04eb8c84-ca70-42e0-81ce-f392d069b63a with Priority: HIGHEST for action port [ 1091.304531] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.304767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.304767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.305059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.305202] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.306216] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.306339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.306569] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-04eb8c84-ca70-42e0-81ce-f392d069b63a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.306696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04eb8c84-ca70-42e0-81ce-f392d069b63a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.306829] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04eb8c84-ca70-42e0-81ce-f392d069b63a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.307370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04eb8c84-ca70-42e0-81ce-f392d069b63a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.307370] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04eb8c84-ca70-42e0-81ce-f392d069b63a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.809201] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.809371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.810196] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04eb8c84-ca70-42e0-81ce-f392d069b63a with status ACTIVE [ 1091.810196] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.810196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.810196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.810196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.810196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.810480] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.810480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.810480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.810646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.810717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.810858] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.810940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.810992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.811141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.811214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.811298] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04eb8c84-ca70-42e0-81ce-f392d069b63a is going to be updated. [ 1091.838761] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.838761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.838761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.839056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.839278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.839372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04eb8c84-ca70-42e0-81ce-f392d069b63a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.041169] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1092.041316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.124295] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-818743b3-1004-4d6a-9000-11b0884942ce tempest-ListServersNegativeTestJSON-336652655 tempest-ListServersNegativeTestJSON-336652655-project-member] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1092.125165] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1092.125165] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.125291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.125291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.125504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.125666] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.125768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.125832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.125978] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.126074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.126166] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.283192] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1092.283376] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1092.283559] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.283751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.284012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.284226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.284372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.284439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.284628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.284905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.285050] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.545660] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-398 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.546072] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.546072] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.547380] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.547380] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.547380] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.547380] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.547380] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.547380] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.547851] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.547851] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.547939] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.548060] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.548237] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.549055] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.549055] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.568561] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.568561] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.568561] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.568935] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.569159] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-44db8400-0343-4aec-9566-c21b8e1d1a76 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.569352] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-44db8400-0343-4aec-9566-c21b8e1d1a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.569470] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-44db8400-0343-4aec-9566-c21b8e1d1a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.569783] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-44db8400-0343-4aec-9566-c21b8e1d1a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.569919] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44db8400-0343-4aec-9566-c21b8e1d1a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.628446] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.628654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.628730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.629138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.629452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.629692] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.629799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.629863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.630030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.630108] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.630259] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 already deleted. [ 1092.630364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.787458] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.073302] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.073526] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.073658] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.073941] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.074105] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.074259] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 44db8400-0343-4aec-9566-c21b8e1d1a76 not found, creating... [ 1093.074527] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.074688] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.074817] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.075058] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.075198] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.075475] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.075631] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.075747] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.075950] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.076097] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.076235] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 44db8400-0343-4aec-9566-c21b8e1d1a76 is going to be created. [ 1093.104519] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.104763] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.104956] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.105330] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.105576] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.105819] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-44db8400-0343-4aec-9566-c21b8e1d1a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.290302] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.793107] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.793406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.793406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.793540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.793615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.793709] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1093.842604] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.842791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.842850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.843085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.843248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.856356] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1093.892598] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-1cc0e5de-6472-4707-a72d-15653e856213 service nova] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_rules [ 1093.892920] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-1cc0e5de-6472-4707-a72d-15653e856213 service nova] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1093.893054] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-1cc0e5de-6472-4707-a72d-15653e856213 service nova] Enqueued Resource ID: 44db8400-0343-4aec-9566-c21b8e1d1a76 with Priority: HIGHEST for action port [ 1093.893535] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_rules [ 1093.893658] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1093.893906] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44db8400-0343-4aec-9566-c21b8e1d1a76 with Priority: HIGHEST for action port [ 1093.894045] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.894269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.894352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.894548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.894642] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.896030] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.896278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.896278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.896390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.896558] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.896638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.896701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.896931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.897044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.897159] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.898209] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-44db8400-0343-4aec-9566-c21b8e1d1a76 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.901408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44db8400-0343-4aec-9566-c21b8e1d1a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.901408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44db8400-0343-4aec-9566-c21b8e1d1a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.901408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44db8400-0343-4aec-9566-c21b8e1d1a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.901408] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44db8400-0343-4aec-9566-c21b8e1d1a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.396612] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.396845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.402438] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.403748] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44db8400-0343-4aec-9566-c21b8e1d1a76 with status ACTIVE [ 1094.403748] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.403748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.403748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.404058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.404058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.405101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.405101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.405101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.405101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.405101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.405101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.405101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.405101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.405488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.405488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.405488] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44db8400-0343-4aec-9566-c21b8e1d1a76 is going to be updated. [ 1094.435478] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.435717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.435717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.436450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.436450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.436450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44db8400-0343-4aec-9566-c21b8e1d1a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.594220] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-3adf0d22-e336-4d5d-8ea7-a4cc001cdffe tempest-ListServersNegativeTestJSON-336652655 tempest-ListServersNegativeTestJSON-336652655-project-member] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1094.594220] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1094.595409] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.595542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.908848] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.414667] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.414754] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.414883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.415272] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.415435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.415620] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be created. [ 1095.443497] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.443734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.443734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.443938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.444119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.452116] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-398 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.452338] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.452430] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.452706] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.452973] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.453152] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.453269] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.453487] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.453627] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.453836] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.454135] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.454245] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.454386] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.454509] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.454617] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.454754] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.457424] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: UNINITIALIZED for 2s [ 1095.473415] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.473518] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.473574] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.473762] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.474286] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-fd85076f-a317-4847-b217-5f6a78076497 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.474460] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-fd85076f-a317-4847-b217-5f6a78076497" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.474512] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-fd85076f-a317-4847-b217-5f6a78076497" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.474832] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-fd85076f-a317-4847-b217-5f6a78076497" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.475658] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd85076f-a317-4847-b217-5f6a78076497',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.868497] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1095.868497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.868497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.868497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.868497] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.868497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.868497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.868497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.868497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.868497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.869105] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.977655] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.978199] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.978199] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.978494] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.978739] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.979335] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port fd85076f-a317-4847-b217-5f6a78076497 not found, creating... [ 1095.979707] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.979916] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.980077] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.980409] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.980595] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.980985] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.981208] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.981348] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.981620] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.981768] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.981912] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: fd85076f-a317-4847-b217-5f6a78076497 is going to be created. [ 1096.006470] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.006844] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.006973] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.007298] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.007582] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.007858] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-fd85076f-a317-4847-b217-5f6a78076497" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.203517] env[65087]: INFO networking_nsxv3.common.synchronization [req-c86803e2-e776-4d44-b650-555f76e13dc0 req-79d3b888-d704-4f30-901b-e8a875d967dd tempest-ServerDiskConfigTestJSON-925595890 tempest-ServerDiskConfigTestJSON-925595890-project-member] Enqueued Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1096.203517] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 with Priority: HIGHEST for action security_group_members [ 1096.203517] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e5af08c-4029-463c-937e-2ea7bf68d7d1 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.203517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.203517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.203517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.203517] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.203517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.203517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.203517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.203517] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.203517] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e5af08c-4029-463c-937e-2ea7bf68d7d1',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.370685] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.370685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.370685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.371247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.372084] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.372084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.372084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.372084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.372084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.372492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.372492] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.372598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.372598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.372769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.372964] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.373135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.373207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.373369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.373480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.373560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.373657] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.709221] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.709221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.709221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.709221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.709221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.709221] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.709221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.709221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.709221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.709221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.709221] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 is going to be updated. [ 1096.731117] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-7679a4a7-74cb-48ed-aaa7-ca0c46ad341c service nova] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_rules [ 1096.731222] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-7679a4a7-74cb-48ed-aaa7-ca0c46ad341c service nova] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1096.732237] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-7679a4a7-74cb-48ed-aaa7-ca0c46ad341c service nova] Enqueued Resource ID: fd85076f-a317-4847-b217-5f6a78076497 with Priority: HIGHEST for action port [ 1096.734745] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_rules [ 1096.734975] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1096.735144] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd85076f-a317-4847-b217-5f6a78076497 with Priority: HIGHEST for action port [ 1096.735512] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.735645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.735941] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.736054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.736282] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd85076f-a317-4847-b217-5f6a78076497 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.736426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd85076f-a317-4847-b217-5f6a78076497" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.736494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd85076f-a317-4847-b217-5f6a78076497" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.736757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd85076f-a317-4847-b217-5f6a78076497" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.736886] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd85076f-a317-4847-b217-5f6a78076497',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.740838] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.740924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.741056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.741340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.741510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.753318] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: IN_PROGRESS for 2s [ 1096.876493] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4986f406-ffa8-458b-a142-64bc589ad53b: rpc.has_security_group_logging(os_id): False [ 1096.894226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.894402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.894440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.894656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.894748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.895012] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.895121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.895379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.895379] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.895484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.895686] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.895793] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.895856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.895998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.896083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.896280] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.896376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.896423] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.896563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.896636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.896722] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1096.960487] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.960940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.960940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.960940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.961255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.982856] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1097.042360] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-348508a9-3335-4f09-9bf5-ec557d2ae102 tempest-ListServersNegativeTestJSON-336652655 tempest-ListServersNegativeTestJSON-336652655-project-member] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1097.042360] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1097.042732] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.043342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.240487] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd85076f-a317-4847-b217-5f6a78076497 with status ACTIVE [ 1097.240881] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.241084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.241167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.241383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.241583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.241918] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.242057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.242149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.242325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.242468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.242765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.242873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.242950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.243104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.243181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.243308] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd85076f-a317-4847-b217-5f6a78076497 is going to be updated. [ 1097.271631] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.271631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.271631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.271631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.271631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.271631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd85076f-a317-4847-b217-5f6a78076497" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.377729] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-398 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.377977] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.378136] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.378458] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.378780] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.379024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.379110] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.380132] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.380132] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.380132] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.380132] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.380132] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.380132] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.380411] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.380411] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.380472] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.415400] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.415400] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1097.415400] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.415628] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-398" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.415844] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-2542cc44-d056-4b96-b0d8-76643503b887 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.416057] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-2542cc44-d056-4b96-b0d8-76643503b887" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.416195] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-2542cc44-d056-4b96-b0d8-76643503b887" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.416958] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-2542cc44-d056-4b96-b0d8-76643503b887" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.416958] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2542cc44-d056-4b96-b0d8-76643503b887',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.468581] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1097.468817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.469017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.469261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.469448] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.469569] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.469638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.469785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.469891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.469979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.470088] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.471351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.471538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.471702] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.471805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.471868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.472018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.472097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.472187] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.919477] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.919716] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.919815] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.920212] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.920312] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.920437] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 2542cc44-d056-4b96-b0d8-76643503b887 not found, creating... [ 1097.920713] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.920943] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.921099] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.921329] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.921467] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.921748] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.921906] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.922040] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.922280] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.922426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.922568] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 2542cc44-d056-4b96-b0d8-76643503b887 is going to be created. [ 1097.943716] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.943971] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.944212] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.944548] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.944833] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.945151] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-2542cc44-d056-4b96-b0d8-76643503b887" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.974032] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.974271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.974496] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.477392] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.673078] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-1e8c4255-6f22-4b94-aa87-c8c2601d5209 service nova] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_rules [ 1098.673296] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-1e8c4255-6f22-4b94-aa87-c8c2601d5209 service nova] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1098.673500] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d0cf09b-0101-4766-82c9-22fed6db0053 req-1e8c4255-6f22-4b94-aa87-c8c2601d5209 service nova] Enqueued Resource ID: 2542cc44-d056-4b96-b0d8-76643503b887 with Priority: HIGHEST for action port [ 1098.674128] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_rules [ 1098.674284] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1098.674388] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2542cc44-d056-4b96-b0d8-76643503b887 with Priority: HIGHEST for action port [ 1098.674691] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.674801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.675021] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.675119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.675303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2542cc44-d056-4b96-b0d8-76643503b887 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.675597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2542cc44-d056-4b96-b0d8-76643503b887" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.675719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2542cc44-d056-4b96-b0d8-76643503b887" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.675910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2542cc44-d056-4b96-b0d8-76643503b887" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.676047] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2542cc44-d056-4b96-b0d8-76643503b887',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.762037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 in Status: SUCCESS [ 1098.762228] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e5af08c-4029-463c-937e-2ea7bf68d7d1 deletion is rescheduled due to dependency. [ 1098.762362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e5af08c-4029-463c-937e-2ea7bf68d7d1" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.981128] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.981128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.981128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.981128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.981413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.981413] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be updated. [ 1099.004691] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1099.004980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.029113] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.029387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.029387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.029614] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.029854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.047230] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 2s [ 1099.180298] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2542cc44-d056-4b96-b0d8-76643503b887 with status ACTIVE [ 1099.181050] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.181050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.181050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.181050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.181050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.181340] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.181425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.181477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.181791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.181791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.181904] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.182019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.182087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.182234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.182312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.182397] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2542cc44-d056-4b96-b0d8-76643503b887 is going to be updated. [ 1099.207187] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.207302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.207368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.207628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.207799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.208044] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2542cc44-d056-4b96-b0d8-76643503b887" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.058601] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1101.058976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.059184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.059496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.059710] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.059843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.059919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.060092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.060198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.060295] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.563030] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.065451] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.567981] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.568207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.568519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.568843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.569021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.570073] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be updated. [ 1102.607362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.607523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.607596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.607926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.608129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.626895] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 2s [ 1103.675623] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1103.675623] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1104.622572] env[65087]: INFO networking_nsxv3.common.synchronization [req-3dda9b4c-2a1f-4db8-9496-61899ffb3fa1 req-75211041-f415-4d78-a451-76882b6d7927 tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1104.623172] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1104.623510] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.623654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.623736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.624039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.624235] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.624479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.624563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.624811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.625102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.625197] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.641819] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1104.642069] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.642523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.642802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.647065] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.647295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.647372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.647578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.647670] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.647775] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.127875] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.127875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.127875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.128258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.128258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.128258] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.128374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.128400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.128542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.128665] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.128712] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1105.152785] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.158367] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.158721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.158964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.159360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.160730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.170434] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1105.641177] env[65087]: INFO networking_nsxv3.common.synchronization [None req-1fd1bf6c-4ca4-4c81-8009-2189534fbe7f None None] Enqueued Resource ID: 796fae13-d1ce-4e7f-b3e3-17253a7c52fa with Priority: HIGHEST for action port [ 1105.641755] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 796fae13-d1ce-4e7f-b3e3-17253a7c52fa with Priority: HIGHEST for action port [ 1105.642196] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-796fae13-d1ce-4e7f-b3e3-17253a7c52fa taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.642353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-796fae13-d1ce-4e7f-b3e3-17253a7c52fa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.642412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-796fae13-d1ce-4e7f-b3e3-17253a7c52fa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.643356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-796fae13-d1ce-4e7f-b3e3-17253a7c52fa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.643356] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('796fae13-d1ce-4e7f-b3e3-17253a7c52fa',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.661295] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.147668] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 796fae13-d1ce-4e7f-b3e3-17253a7c52fa [ 1106.148661] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.148661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.148661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.148661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.148661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.148661] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:796fae13-d1ce-4e7f-b3e3-17253a7c52fa already deleted. [ 1106.148661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-796fae13-d1ce-4e7f-b3e3-17253a7c52fa" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.164170] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.164393] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.164663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.164919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.164988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.165111] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be updated. [ 1106.208335] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.208636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.208636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.208799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.208906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.219699] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 2s [ 1107.181389] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1107.182063] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1107.182063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.792657] env[65087]: INFO networking_nsxv3.common.synchronization [req-9b44595f-fc47-4bce-9acc-499126fd2468 req-9d5933fa-ba27-4d8b-ab44-18f5fe14d107 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 1107.793269] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 1107.793621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.793822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.793822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.794079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.794214] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.794680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.794680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.794680] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.794815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.794815] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.123755] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-733 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.123980] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.124195] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.124508] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.124827] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.125023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.125135] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.125422] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.125647] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.125881] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.126018] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1108.126190] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1108.126256] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1108.126355] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1108.126566] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1108.126598] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1108.147698] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1108.147906] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1108.148061] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1108.148244] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-733" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.148563] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-5ad1ae0c-1caa-4587-a07a-05659e5298fb taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.148750] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-5ad1ae0c-1caa-4587-a07a-05659e5298fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.148903] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-5ad1ae0c-1caa-4587-a07a-05659e5298fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.149272] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-5ad1ae0c-1caa-4587-a07a-05659e5298fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.149411] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ad1ae0c-1caa-4587-a07a-05659e5298fb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.230194] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 4s [ 1108.232298] env[65087]: INFO networking_nsxv3.common.synchronization [None req-21f0c854-1960-499b-adbd-bddbe8531e25 None None] Enqueued Resource ID: e5fdf51c-be33-4934-91c9-53a2fb7f9be8 with Priority: HIGHEST for action port [ 1108.232808] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5fdf51c-be33-4934-91c9-53a2fb7f9be8 with Priority: HIGHEST for action port [ 1108.233373] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5fdf51c-be33-4934-91c9-53a2fb7f9be8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.233495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5fdf51c-be33-4934-91c9-53a2fb7f9be8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.233593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5fdf51c-be33-4934-91c9-53a2fb7f9be8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.233833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5fdf51c-be33-4934-91c9-53a2fb7f9be8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.233922] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5fdf51c-be33-4934-91c9-53a2fb7f9be8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.296887] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.655028] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.655028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.655028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.655028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.655028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.655028] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 5ad1ae0c-1caa-4587-a07a-05659e5298fb not found, creating... [ 1108.655028] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.655028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.655028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.655028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.655028] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.656104] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.656104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.656104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.656104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.656104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.656369] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 5ad1ae0c-1caa-4587-a07a-05659e5298fb is going to be created. [ 1108.681416] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.681693] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.681827] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.682222] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.682644] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.683044] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-5ad1ae0c-1caa-4587-a07a-05659e5298fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.737081] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5fdf51c-be33-4934-91c9-53a2fb7f9be8 [ 1108.737081] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.737081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.737081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.737336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.737368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.737454] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5fdf51c-be33-4934-91c9-53a2fb7f9be8 already deleted. [ 1108.737568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5fdf51c-be33-4934-91c9-53a2fb7f9be8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.799430] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.304019] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.304019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.304019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.304019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.304019] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.304019] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be updated. [ 1109.335658] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.335799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.336686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.336686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.336686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.347513] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: IN_PROGRESS for 2s [ 1109.447084] env[65087]: INFO networking_nsxv3.common.synchronization [req-9b44595f-fc47-4bce-9acc-499126fd2468 req-f2e4a9a9-1679-4809-91d0-637952e6d061 service nova] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_rules [ 1109.447084] env[65087]: INFO networking_nsxv3.common.synchronization [req-9b44595f-fc47-4bce-9acc-499126fd2468 req-f2e4a9a9-1679-4809-91d0-637952e6d061 service nova] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 1109.447084] env[65087]: INFO networking_nsxv3.common.synchronization [req-9b44595f-fc47-4bce-9acc-499126fd2468 req-f2e4a9a9-1679-4809-91d0-637952e6d061 service nova] Enqueued Resource ID: 5ad1ae0c-1caa-4587-a07a-05659e5298fb with Priority: HIGHEST for action port [ 1109.447407] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_rules [ 1109.447407] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 1109.447510] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad1ae0c-1caa-4587-a07a-05659e5298fb with Priority: HIGHEST for action port [ 1109.447791] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.447918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.448049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.448236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.448320] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.449237] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.449332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.450151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ad1ae0c-1caa-4587-a07a-05659e5298fb taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.450285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ad1ae0c-1caa-4587-a07a-05659e5298fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.450404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ad1ae0c-1caa-4587-a07a-05659e5298fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.450554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ad1ae0c-1caa-4587-a07a-05659e5298fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.450633] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ad1ae0c-1caa-4587-a07a-05659e5298fb',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.957168] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.957168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ad1ae0c-1caa-4587-a07a-05659e5298fb with status ACTIVE [ 1109.957168] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.957168] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.957168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.957168] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.957685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.957685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.958385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.958626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.958808] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ad1ae0c-1caa-4587-a07a-05659e5298fb is going to be updated. [ 1109.961509] env[65087]: INFO networking_nsxv3.common.synchronization [req-b2651c57-5090-421c-9218-1a1f9defdf87 req-c7357e7f-d481-4807-9558-0292e7597ab1 tempest-ListServersNegativeTestJSON-336652655 tempest-ListServersNegativeTestJSON-336652655-project-member] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1109.962383] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1109.963730] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.963730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.989971] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.989971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.989971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.989971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.989971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.989971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ad1ae0c-1caa-4587-a07a-05659e5298fb" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.243094] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1110.243727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.243727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.244112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.244294] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.244454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.244561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.244766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.244859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.244972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.245184] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.245275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.245346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.245499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.245645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.245745] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.245806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.245944] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.246024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.246139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.247547] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.250449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.250724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.250972] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.251154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.251256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.251474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.251824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.251824] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.413708] env[65087]: INFO networking_nsxv3.common.synchronization [req-0f7c2029-7bc9-444c-b9f8-280879648c62 req-1b57590a-a9c4-4b4f-81ab-cdba68b20807 tempest-ServersV294TestFqdnHostnames-1699101108 tempest-ServersV294TestFqdnHostnames-1699101108-project-member] Enqueued Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_members [ 1110.414423] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7083382f-6e66-45d0-9fc4-efa15b381900 with Priority: HIGHEST for action security_group_members [ 1110.414749] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-7083382f-6e66-45d0-9fc4-efa15b381900 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.414874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.414942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.415157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.415313] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.415415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.415471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.415615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.415701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.415794] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7083382f-6e66-45d0-9fc4-efa15b381900',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.750192] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dab47907-64f9-4468-a245-f87ca3fbeec8: rpc.has_security_group_logging(os_id): False [ 1110.754154] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.769429] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.769715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.769715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.769777] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.769875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.770061] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.770176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.770257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.770431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.770514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.770721] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.770832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.770888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.771041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.771120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.771297] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.771391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.771453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.771590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.771662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.771746] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be created. [ 1110.843516] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.843516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.843516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.843516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.843516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.860710] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 2s [ 1110.918958] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.918958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.918958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.919255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.950902] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.951203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.951337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.951409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.951620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.951707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.951802] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7083382f-6e66-45d0-9fc4-efa15b381900 is going to be updated. [ 1110.989040] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.989040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.989040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.989040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.989298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.998321] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7083382f-6e66-45d0-9fc4-efa15b381900 in Status: IN_PROGRESS for 2s [ 1111.257302] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.360828] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: SUCCESS [ 1111.361248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.361474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.361734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.361953] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.362114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.362231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.362407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.362539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.362651] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.760332] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.760771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.760771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.760856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.760888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.761020] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be updated. [ 1111.795690] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.795866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.796586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.796586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.796586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.819663] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 2s [ 1111.866264] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.196267] env[65087]: INFO networking_nsxv3.common.synchronization [req-5a13840d-95ac-4275-9757-9f650883ae1b req-1a91e137-0e92-4522-a457-3425e3235868 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1112.197397] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1112.198191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.198490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.198600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.198904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.199136] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.199275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.201023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.201023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.201023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.201023] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.508708] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.630828] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.631137] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.631298] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.631679] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.633041] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.633041] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.633041] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.633041] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.633247] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.633443] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.633698] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.633811] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.633985] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.634213] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.634399] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.634666] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.660055] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.660055] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.660055] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.660055] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.660055] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.660382] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.660382] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.660689] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.660867] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a37fbf2e-57f6-40b0-9473-2a2cf2f1f196',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.702952] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.702952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.703162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.703353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.703462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.703695] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.703794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.703857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.704041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.704120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.704203] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec already deleted. [ 1112.704284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.873962] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1112.874976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.874976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.874976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.874976] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.880918] env[65087]: INFO networking_nsxv3.common.synchronization [req-e41b77d7-99bd-424c-9668-b04ccef2172a req-ecbe8722-9566-45e7-90e1-f99a978d2e42 tempest-ServerRescueNegativeTestJSON-853652026 tempest-ServerRescueNegativeTestJSON-853652026-project-member] Enqueued Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_members [ 1112.881463] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGHEST for action security_group_members [ 1112.881803] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.881924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.881993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.882267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.882567] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.882803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.882803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.882910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.882977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.883045] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.011890] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7083382f-6e66-45d0-9fc4-efa15b381900 in Status: SUCCESS [ 1113.012046] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7083382f-6e66-45d0-9fc4-efa15b381900 deletion is rescheduled due to dependency. [ 1113.012177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7083382f-6e66-45d0-9fc4-efa15b381900" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.012705] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.012879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.013037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.013283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.013478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.014132] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be updated. [ 1113.059402] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.059564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.059633] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.059975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.060425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.070435] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: IN_PROGRESS for 2s [ 1113.163826] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.163826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.163826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.164096] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.164096] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.164271] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port a37fbf2e-57f6-40b0-9473-2a2cf2f1f196 not found, creating... [ 1113.164502] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.164977] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.164977] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.164977] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.165232] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.166082] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.166082] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.166082] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.166082] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.166082] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.170028] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: a37fbf2e-57f6-40b0-9473-2a2cf2f1f196 is going to be created. [ 1113.192489] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.192726] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.192850] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.193267] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.193542] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.193631] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.377498] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.377498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.385372] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.385520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.385520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.385707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.385805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.386055] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.386193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.386247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.386424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.386519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.386623] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d49db7-880a-475c-959f-8bf596c72350 is going to be updated. [ 1113.426706] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.426888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.427114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.427437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.427720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.438992] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d49db7-880a-475c-959f-8bf596c72350 in Status: IN_PROGRESS for 2s [ 1113.832902] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1113.833264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.833553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.833881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.834211] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.834392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.834488] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.834752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.834887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.835082] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.968379] env[65087]: INFO networking_nsxv3.common.synchronization [req-5a13840d-95ac-4275-9757-9f650883ae1b req-8a46425e-1e1e-4329-b4ec-0c240701ddd5 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1113.968897] env[65087]: INFO networking_nsxv3.common.synchronization [req-5a13840d-95ac-4275-9757-9f650883ae1b req-8a46425e-1e1e-4329-b4ec-0c240701ddd5 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1113.969214] env[65087]: INFO networking_nsxv3.common.synchronization [req-5a13840d-95ac-4275-9757-9f650883ae1b req-8a46425e-1e1e-4329-b4ec-0c240701ddd5 service nova] Enqueued Resource ID: a37fbf2e-57f6-40b0-9473-2a2cf2f1f196 with Priority: HIGHEST for action port [ 1113.969847] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1113.970044] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1113.970139] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a37fbf2e-57f6-40b0-9473-2a2cf2f1f196 with Priority: HIGHEST for action port [ 1113.970403] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.970576] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.970655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.970912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.970992] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.972095] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.972191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.972246] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.972470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.972634] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.972730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.972794] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.972961] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.973982] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.973982] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.974758] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.974860] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.974928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.975135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.976054] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a37fbf2e-57f6-40b0-9473-2a2cf2f1f196',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.339637] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.479319] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.479319] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.479452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.479606] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a37fbf2e-57f6-40b0-9473-2a2cf2f1f196 with status ACTIVE [ 1114.479856] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.479994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.480095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.480338] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.480474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.480669] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.480787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.480852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.481020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.481251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.481529] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.481631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.481695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.481861] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.481941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.482040] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a37fbf2e-57f6-40b0-9473-2a2cf2f1f196 is going to be updated. [ 1114.508433] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.508433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.508433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.508596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.508791] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.510040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a37fbf2e-57f6-40b0-9473-2a2cf2f1f196" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.844228] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.984939] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.084806] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: SUCCESS [ 1115.085058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.085294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.085579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.085804] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.085979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.086109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.086365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.086420] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.086515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.086619] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.346636] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.346816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.346816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.347137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.347300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.347450] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be updated. [ 1115.388933] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.389133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.389200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.389494] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.389734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.403173] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 2s [ 1115.468762] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39d49db7-880a-475c-959f-8bf596c72350 in Status: SUCCESS [ 1115.468762] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39d49db7-880a-475c-959f-8bf596c72350 deletion is rescheduled due to dependency. [ 1115.468922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.487580] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.487737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.487811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.488098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.488217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.488318] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be created. [ 1115.517857] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.518015] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.518115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.518579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.518763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.532939] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: UNINITIALIZED for 2s [ 1115.589587] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.092467] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d11ae3e7-68e0-48ab-9cf6-d1803117fc1f: rpc.has_security_group_logging(os_id): False [ 1116.114877] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.115123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.115206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.115433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.115527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.115870] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.116017] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.116092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.116268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.116350] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.116448] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be updated. [ 1116.183138] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.183390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.183390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.183656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.183816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.207171] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: IN_PROGRESS for 2s [ 1116.899308] env[65087]: INFO networking_nsxv3.common.synchronization [req-cdd1f9a8-d2d1-4ea6-960a-29920df5b192 req-201df674-0a82-4264-8354-215cb72ea5e3 tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1116.901328] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1116.901328] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.901328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.901328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.901328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.902719] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.902719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.902719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.902719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.902719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.902719] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.405681] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.408075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.408075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.408075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.408075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.408075] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.408075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.408075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.408075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.408075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.411120] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1117.414581] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.415099] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.415338] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.415712] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.419684] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.419684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.419684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.419684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.419684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.419684] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.419684] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.419684] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.419684] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.419684] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.419684] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.419684] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.441268] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1117.442048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.442656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.443072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.443392] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.443634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.443784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.445454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.446480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.446480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.446480] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.463274] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.463552] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1117.463960] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.464093] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.464989] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.464989] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.465567] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.466244] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.466488] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f24e520-fdb0-493b-8d0e-2f324ae45eb4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.512500] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.512684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.512721] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.512931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.513091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.549150] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1117.558663] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1117.558784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.559663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.559841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.560275] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.560275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.560275] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.560464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.560548] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.561237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.561444] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.949289] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.949770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.949947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.950170] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.950686] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.950686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.950686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.950863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.950863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.950958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.951101] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.951208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.951270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.951462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.951940] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.951940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.951940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.952141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.952234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.952323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.952439] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.970029] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.970286] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.970409] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.970710] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.971058] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.971058] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 2f24e520-fdb0-493b-8d0e-2f324ae45eb4 not found, creating... [ 1117.971307] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.971468] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.971578] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.972133] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.972281] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.972588] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.972764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.972917] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.973181] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.973710] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.974104] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 2f24e520-fdb0-493b-8d0e-2f324ae45eb4 is going to be created. [ 1118.015341] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.015580] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.015707] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.016011] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.016269] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.016512] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.067463] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.067826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.068304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.068426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.068711] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.068913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.069088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.069401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.069598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.069787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.070144] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.070320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.070436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.070738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.071016] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.071192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.071335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.071578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.071755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.071923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.072103] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.104311] env[65087]: INFO networking_nsxv3.common.synchronization [req-4c18de2c-024d-42ed-a158-fd00753b364d req-5651d2da-efaa-471b-b7f6-11500070fcbb tempest-ListServersNegativeTestJSON-336652655 tempest-ListServersNegativeTestJSON-336652655-project-member] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1118.105700] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1118.106298] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.106498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.106610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.106938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.107286] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.107485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.107593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.107900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.108077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.108283] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.237075] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: SUCCESS [ 1118.237419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.460063] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dab47907-64f9-4468-a245-f87ca3fbeec8: rpc.has_security_group_logging(os_id): False [ 1118.485484] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.485484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.485801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.494191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.494191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.494191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.494191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.494672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.494672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.494672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.494672] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be updated. [ 1118.580576] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f55d553-c00f-4d69-9855-eb76f08469ec: rpc.has_security_group_logging(os_id): False [ 1118.581463] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.581611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.581684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.581918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.582085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.601881] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.602189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.602189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.602396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.602499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.602741] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.602875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.602979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.603169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.603315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.603596] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.603695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.603757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.603915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.604011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.604325] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.604481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.604532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.604664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.604756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.604824] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be created. [ 1118.607518] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 2s [ 1118.612019] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.699856] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.700124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.700124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.700374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.700674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.720060] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1118.899708] env[65087]: INFO networking_nsxv3.common.synchronization [req-cdd1f9a8-d2d1-4ea6-960a-29920df5b192 req-4476e2df-ea09-45f3-b755-22d22f6d32a5 service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 1118.899961] env[65087]: INFO networking_nsxv3.common.synchronization [req-cdd1f9a8-d2d1-4ea6-960a-29920df5b192 req-4476e2df-ea09-45f3-b755-22d22f6d32a5 service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1118.900092] env[65087]: INFO networking_nsxv3.common.synchronization [req-cdd1f9a8-d2d1-4ea6-960a-29920df5b192 req-4476e2df-ea09-45f3-b755-22d22f6d32a5 service nova] Enqueued Resource ID: 2f24e520-fdb0-493b-8d0e-2f324ae45eb4 with Priority: HIGHEST for action port [ 1118.900652] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 1118.900792] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1118.900915] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f24e520-fdb0-493b-8d0e-2f324ae45eb4 with Priority: HIGHEST for action port [ 1118.901438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.901626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.901722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.901967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.902098] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.903197] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.903344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.903620] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.903813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.903904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.904218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.904377] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f24e520-fdb0-493b-8d0e-2f324ae45eb4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.006477] env[65087]: INFO networking_nsxv3.common.synchronization [req-052339db-360b-46c4-a7bd-5aba130dbf1f req-b0497c64-26cc-4d68-808a-9eaef0d73d8f tempest-ListServersNegativeTestJSON-336652655 tempest-ListServersNegativeTestJSON-336652655-project-member] Enqueued Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1119.007560] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab47907-64f9-4468-a245-f87ca3fbeec8 with Priority: HIGHEST for action security_group_members [ 1119.008119] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dab47907-64f9-4468-a245-f87ca3fbeec8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.008281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.114653] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.406440] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.406674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.406973] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2f24e520-fdb0-493b-8d0e-2f324ae45eb4 with status ACTIVE [ 1119.407220] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.407363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.407441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.407765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.407890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.408122] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.408263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.408411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.408628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.408728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.408965] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.409196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.409307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.409502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.409597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.409768] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2f24e520-fdb0-493b-8d0e-2f324ae45eb4 is going to be updated. [ 1119.435547] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.435689] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.435774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.436035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.436184] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.436346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f24e520-fdb0-493b-8d0e-2f324ae45eb4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.570690] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1119.571214] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1119.571214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.571214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.571410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.571601] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.571733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.571789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.571940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.572051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.572161] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.618693] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.618693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.618693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.618926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.618926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.618983] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be updated. [ 1119.651951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.651951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.652120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.652237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.652395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.664397] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: IN_PROGRESS for 2s [ 1120.075561] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.577088] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.626255] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1120.627046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.627046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.627046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.627046] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.733934] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1120.733934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.081171] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.081411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.081411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.081656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.081751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.081912] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1121.118381] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.118662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.118662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.118977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.119138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.129857] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1121.150088] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.150295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.150354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.150595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.150705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.150846] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be deleted. [ 1121.218020] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.218220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.218341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.218626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.218626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.218735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.450154] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.450411] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.450610] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.450922] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.451362] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.451625] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.451793] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.453666] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.453666] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.453666] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.453666] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.453666] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.453666] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.453666] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.453666] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.453666] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.474584] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.474800] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1121.474935] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.475470] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.475647] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.476081] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.476235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.476595] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.476788] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc9cb05-0d28-4a57-9cad-06d453fbd1b4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.676144] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dab47907-64f9-4468-a245-f87ca3fbeec8 in Status: SUCCESS [ 1121.676609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.676609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.676808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.676995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.677138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.677411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.677702] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.677832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.677990] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dab47907-64f9-4468-a245-f87ca3fbeec8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.981281] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.981281] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.981281] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.981281] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.981281] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.981281] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 not found, creating... [ 1121.981561] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.981754] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.982061] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.982240] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.982394] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.982692] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.982856] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.983023] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.983302] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.983503] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.983728] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 is going to be created. [ 1122.005578] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.006660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.006660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.006660] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.006882] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.007029] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.181069] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.181258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.181397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.181666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.181789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.182025] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.182164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.182255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.182428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.182539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.182641] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dab47907-64f9-4468-a245-f87ca3fbeec8 is going to be deleted. [ 1122.216411] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.216635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.216635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.216842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.216930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.217039] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dab47907-64f9-4468-a245-f87ca3fbeec8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.737731] env[65087]: INFO networking_nsxv3.common.synchronization [req-2fd2d511-be68-4d4f-aace-8777808a7061 req-ca2c86fc-3e17-40ac-9cd0-7636f7b3cb71 service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 1122.738196] env[65087]: INFO networking_nsxv3.common.synchronization [req-2fd2d511-be68-4d4f-aace-8777808a7061 req-ca2c86fc-3e17-40ac-9cd0-7636f7b3cb71 service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1122.738458] env[65087]: INFO networking_nsxv3.common.synchronization [req-2fd2d511-be68-4d4f-aace-8777808a7061 req-ca2c86fc-3e17-40ac-9cd0-7636f7b3cb71 service nova] Enqueued Resource ID: 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 with Priority: HIGHEST for action port [ 1122.739128] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 1122.739328] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1122.739461] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 with Priority: HIGHEST for action port [ 1122.739800] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.739977] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.740072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.740320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.740409] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.742505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.742505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.742505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.742505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.742505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.742505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.742505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.742929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.742929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.743062] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.744951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.745469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.745580] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.745825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.745940] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc9cb05-0d28-4a57-9cad-06d453fbd1b4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.141365] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1123.141844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.143850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.143946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.145070] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.145070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.145397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.145817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.146409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.146697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.146945] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.242378] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.242891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.246087] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.249388] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 with status ACTIVE [ 1123.250106] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.253020] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.253020] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.253020] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.253020] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 is going to be updated. [ 1123.295990] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.295990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.295990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.295990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.295990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.295990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.651715] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.651932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.651932] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.652255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.652341] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.652426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.652482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.652636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.652734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.652809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.652953] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.653075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.653130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.653274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.653408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.653497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.653584] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.653712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.653786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.653870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.653961] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.748672] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.794588] env[65087]: INFO networking_nsxv3.common.synchronization [None req-57103823-f9eb-44dc-baf2-107b2bff1952 None None] Enqueued Resource ID: d039bad1-999c-4572-8a88-cbd62ab910d8 with Priority: HIGHEST for action port [ 1123.796992] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d039bad1-999c-4572-8a88-cbd62ab910d8 with Priority: HIGHEST for action port [ 1123.796992] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-d039bad1-999c-4572-8a88-cbd62ab910d8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.796992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d039bad1-999c-4572-8a88-cbd62ab910d8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.797378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d039bad1-999c-4572-8a88-cbd62ab910d8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.797858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d039bad1-999c-4572-8a88-cbd62ab910d8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.798082] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d039bad1-999c-4572-8a88-cbd62ab910d8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.159842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4986f406-ffa8-458b-a142-64bc589ad53b: rpc.has_security_group_logging(os_id): False [ 1124.179462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.179622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.179673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.179901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.180023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.180396] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.180396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.180531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.180571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.180656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.180824] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.180938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.180972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.181133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.181210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.181407] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.183596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.183705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.183876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.183960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.184070] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1124.250981] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.251153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.251281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.251532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.251697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.253145] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.253283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.253353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.253519] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.253811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.253918] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1124.268121] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1124.286035] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.287979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.287979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.287979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.287979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.296503] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1124.299984] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d039bad1-999c-4572-8a88-cbd62ab910d8 [ 1124.300250] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.300408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.300481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.300699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.301145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.301287] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d039bad1-999c-4572-8a88-cbd62ab910d8 already deleted. [ 1124.301386] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d039bad1-999c-4572-8a88-cbd62ab910d8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.176032] env[65087]: INFO networking_nsxv3.common.synchronization [None req-8af860c8-1647-4ccb-b5f4-16b3ed448497 None None] Enqueued Resource ID: adeb7c14-5edc-469e-86f3-718147232c87 with Priority: HIGHEST for action port [ 1126.177017] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adeb7c14-5edc-469e-86f3-718147232c87 with Priority: HIGHEST for action port [ 1126.177017] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-adeb7c14-5edc-469e-86f3-718147232c87 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.178138] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adeb7c14-5edc-469e-86f3-718147232c87" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.178253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adeb7c14-5edc-469e-86f3-718147232c87" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.178951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adeb7c14-5edc-469e-86f3-718147232c87" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.178951] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adeb7c14-5edc-469e-86f3-718147232c87',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.283585] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1126.283854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.305704] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1126.306029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.306363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.306629] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.307331] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.307331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.307331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.307331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.307331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.307580] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.307580] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.681826] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port adeb7c14-5edc-469e-86f3-718147232c87 [ 1126.681826] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.681826] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.682077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.682141] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.682231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.682331] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:adeb7c14-5edc-469e-86f3-718147232c87 already deleted. [ 1126.682416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adeb7c14-5edc-469e-86f3-718147232c87" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.810100] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.810100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.810413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.810413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.810520] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.810751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.810751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.810861] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.810926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.811096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.811168] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.811258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.811320] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.811460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.811610] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.811700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.811757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.811893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.811970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.812062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.812151] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.318804] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 078ba4a4-0e86-4b25-838d-1fc110729dbd: rpc.has_security_group_logging(os_id): False [ 1127.337180] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.337464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.337611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.337942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.338747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.338747] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.338747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.338956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.339229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.339397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.339713] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.339914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.340080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.340300] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.340492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.340917] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.341118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.341250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.341509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.343037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.343037] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1127.424473] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.424473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.424473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.424724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.425988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.440048] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1129.456534] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1129.456941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.764188] env[65087]: INFO networking_nsxv3.common.synchronization [req-6068469b-3db4-4e3f-8e8b-a7649ffb4887 req-27d59e59-1908-4604-9414-b94b5a1bb9d9 tempest-ServerRescueNegativeTestJSON-853652026 tempest-ServerRescueNegativeTestJSON-853652026-project-member] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 1129.764188] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 1129.764188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.764188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.764188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.764188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.764188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.764188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.764188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.764188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.764188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.764188] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.265746] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.769650] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.819045] env[65087]: INFO networking_nsxv3.common.synchronization [req-f6c30b67-6ce7-4de1-9f5c-2391e61dd75d req-6511b4f9-5cf7-4a5e-bc07-ff8ec4b0e35e tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1130.819600] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1130.819921] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.820061] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.820129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.820349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.820510] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.820608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.820669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.820812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.820898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.820987] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.273511] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.274058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.274195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.274464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.274640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.274862] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be updated. [ 1131.310330] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.311038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.311038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.311335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.311602] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.323889] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: IN_PROGRESS for 2s [ 1131.324336] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.324502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.324808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.324945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.325109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.325480] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.325608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.325687] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.325901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.325984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.326127] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1131.368123] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.368123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.368387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.369056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.369056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.383418] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1133.334903] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 1133.335189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.394319] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1133.394319] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 deletion is rescheduled due to dependency. [ 1133.394319] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.712129] env[65087]: INFO networking_nsxv3.common.synchronization [req-c8780953-5037-45ee-8f7e-5dd4d1feb4ca req-67a04d1c-60a6-4066-a8ac-85544e3427d3 tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1133.712378] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1133.712690] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.712806] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.712871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.713080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.713232] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.713323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.713383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.713524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.713603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.713693] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.215722] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.215904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.215946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.216179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.216274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.216473] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.216573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.216635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.216952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.216952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.216952] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1134.245544] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.245704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.245789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.246201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.246201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.254922] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1134.763288] env[65087]: INFO networking_nsxv3.common.synchronization [req-2ffff575-cddc-412e-914f-899b78aa8774 req-fa7485fd-4001-4612-9a10-f3e9c1b2a8f2 tempest-InstanceActionsNegativeTestJSON-1586907394 tempest-InstanceActionsNegativeTestJSON-1586907394-project-member] Enqueued Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGHEST for action security_group_members [ 1134.763881] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGHEST for action security_group_members [ 1134.764136] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.764304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.764342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.764579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.764737] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.764851] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.764922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.765079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.765161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.765266] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.090657] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.090861] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-594" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.090984] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-594" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.091581] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-594" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.091788] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.092114] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.092258] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.092618] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.092872] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.093326] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.093326] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.093425] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.093584] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.093721] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.093853] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.093999] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.114888] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.115033] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.115638] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.115638] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-594" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.115837] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-7cada04c-551f-4e29-b0e9-83f239636637 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.116037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-7cada04c-551f-4e29-b0e9-83f239636637" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.116167] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-7cada04c-551f-4e29-b0e9-83f239636637" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.116528] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-7cada04c-551f-4e29-b0e9-83f239636637" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.116667] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cada04c-551f-4e29-b0e9-83f239636637',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.269048] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.269048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.269221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.269397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.269583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.269776] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.269891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.269968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.270167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.270286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.270419] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e already deleted. [ 1135.270547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.622019] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.622019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.622019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.622019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.622019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.622019] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 7cada04c-551f-4e29-b0e9-83f239636637 not found, creating... [ 1135.622019] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.622019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.622019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.622019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.622019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.622548] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.622548] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.622548] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.623051] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.623351] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.623625] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 7cada04c-551f-4e29-b0e9-83f239636637 is going to be created. [ 1135.646293] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.646293] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.646293] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.646293] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.646293] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.646293] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-7cada04c-551f-4e29-b0e9-83f239636637" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.265893] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1136.266276] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1136.266276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.340686] env[65087]: INFO networking_nsxv3.common.synchronization [req-2ffff575-cddc-412e-914f-899b78aa8774 req-8ef3436d-1419-44ae-b365-3fa06f00b540 service nova] Enqueued Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGHEST for action security_group_rules [ 1136.340871] env[65087]: INFO networking_nsxv3.common.synchronization [req-2ffff575-cddc-412e-914f-899b78aa8774 req-8ef3436d-1419-44ae-b365-3fa06f00b540 service nova] Enqueued Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGHEST for action security_group_members [ 1136.341028] env[65087]: INFO networking_nsxv3.common.synchronization [req-2ffff575-cddc-412e-914f-899b78aa8774 req-8ef3436d-1419-44ae-b365-3fa06f00b540 service nova] Enqueued Resource ID: 7cada04c-551f-4e29-b0e9-83f239636637 with Priority: HIGHEST for action port [ 1136.341549] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGHEST for action security_group_rules [ 1136.341706] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGHEST for action security_group_members [ 1136.341777] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cada04c-551f-4e29-b0e9-83f239636637 with Priority: HIGHEST for action port [ 1136.342287] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.342397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.342477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.342867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.342960] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.344485] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.345081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.345226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.345456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.346109] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.346335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.346641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.346876] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.348812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.348812] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.348812] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cada04c-551f-4e29-b0e9-83f239636637 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.348812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cada04c-551f-4e29-b0e9-83f239636637" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.348812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cada04c-551f-4e29-b0e9-83f239636637" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.348812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cada04c-551f-4e29-b0e9-83f239636637" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.348812] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cada04c-551f-4e29-b0e9-83f239636637',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.851271] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.851271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.854492] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.854589] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cada04c-551f-4e29-b0e9-83f239636637 with status ACTIVE [ 1136.854725] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.854846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.854912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.855157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.855248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.855409] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.855515] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.855600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.855722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.855799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.855991] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.856132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.856197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.856342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.856459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.856494] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cada04c-551f-4e29-b0e9-83f239636637 is going to be updated. [ 1136.878118] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.878216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.878251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.878481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.878594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.878757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cada04c-551f-4e29-b0e9-83f239636637" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.258690] env[65087]: INFO networking_nsxv3.common.synchronization [req-c5901e9b-6fcd-48b9-bfec-001d2bd2584f req-4d3f2ecd-9b99-4e65-ac8d-459443b27cff tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1137.258870] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1137.259085] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.259282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.259363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.259499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.259713] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.259809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.259868] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.259987] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.260120] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.260227] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.359293] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.588188] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.588188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.588188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.588188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.588188] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.588188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.588188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.588188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.588188] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.588188] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1137.588188] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.588188] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.589747] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.590861] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1137.592692] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.592692] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.610932] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.611095] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1137.611204] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.611376] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.611946] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.611946] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.612116] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.613235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.613235] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d94830a-4558-4c1d-bc0d-f3be929d2fd8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.762480] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.862091] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.862269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.862333] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.862505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.862596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.862694] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e is going to be created. [ 1137.889068] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.889385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.889543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.889980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.890273] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.900629] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e in Status: UNINITIALIZED for 2s [ 1138.114505] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.115046] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.115046] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.115128] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.115307] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.115455] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 2d94830a-4558-4c1d-bc0d-f3be929d2fd8 not found, creating... [ 1138.115716] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.115874] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.116012] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.116241] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.116383] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.116707] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.116796] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.116913] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.117158] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.117442] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.117492] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 2d94830a-4558-4c1d-bc0d-f3be929d2fd8 is going to be created. [ 1138.142018] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.142486] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.142486] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.142755] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.142988] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.143231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.268321] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.773253] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.773253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.773253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.773253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.773253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.773253] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1138.800553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.800858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.801035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.801313] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.801551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.810570] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1138.835082] env[65087]: INFO networking_nsxv3.common.synchronization [req-c5901e9b-6fcd-48b9-bfec-001d2bd2584f req-a1457e13-7955-4122-8e2c-0bff4a890b35 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1138.835082] env[65087]: INFO networking_nsxv3.common.synchronization [req-c5901e9b-6fcd-48b9-bfec-001d2bd2584f req-a1457e13-7955-4122-8e2c-0bff4a890b35 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1138.835082] env[65087]: INFO networking_nsxv3.common.synchronization [req-c5901e9b-6fcd-48b9-bfec-001d2bd2584f req-a1457e13-7955-4122-8e2c-0bff4a890b35 service nova] Enqueued Resource ID: 2d94830a-4558-4c1d-bc0d-f3be929d2fd8 with Priority: HIGHEST for action port [ 1138.835082] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1138.835082] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1138.835082] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d94830a-4558-4c1d-bc0d-f3be929d2fd8 with Priority: HIGHEST for action port [ 1138.835911] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.836213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.836364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.836899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.837098] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.839080] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.839439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.839974] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.840773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.840773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.840773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.841881] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d94830a-4558-4c1d-bc0d-f3be929d2fd8',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.883696] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-916 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.883967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.884552] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.884875] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.885194] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.885411] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.885615] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.885886] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.886088] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.886334] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.886481] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.886821] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.886821] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.886821] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.887013] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.887183] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.905699] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.905699] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.906372] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.906618] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-916" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.907035] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.907250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.907378] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.907674] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.907835] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc9cb05-0d28-4a57-9cad-06d453fbd1b4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.343142] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.343331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.343499] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d94830a-4558-4c1d-bc0d-f3be929d2fd8 with status ACTIVE [ 1139.343673] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.343788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.343857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.344216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.344475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.344711] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.344823] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.344893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.345087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.345174] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.345366] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.345492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.345562] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.345720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.345799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.345888] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d94830a-4558-4c1d-bc0d-f3be929d2fd8 is going to be updated. [ 1139.374266] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.374558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.374727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.374850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.374998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.375336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d94830a-4558-4c1d-bc0d-f3be929d2fd8" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.410905] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.411191] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.411323] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.411661] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.411903] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.412223] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.412598] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.412598] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.412855] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.413034] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.413389] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.413612] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.413724] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.413986] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.414194] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.414338] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 is going to be updated. [ 1139.437902] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.438171] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.438325] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.438631] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.438879] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.439096] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.911785] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e in Status: SUCCESS [ 1139.912157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.912653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.912653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.912795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.914022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.914022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.914022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.914022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.914022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.914022] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.136792] env[65087]: INFO networking_nsxv3.common.synchronization [req-2e8139ef-63c3-4a4f-8aa8-57a969415df6 req-5cce7f0c-65ba-40fb-8be9-e1f59d0464b2 service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 1140.138597] env[65087]: INFO networking_nsxv3.common.synchronization [req-2e8139ef-63c3-4a4f-8aa8-57a969415df6 req-5cce7f0c-65ba-40fb-8be9-e1f59d0464b2 service nova] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1140.138830] env[65087]: INFO networking_nsxv3.common.synchronization [req-2e8139ef-63c3-4a4f-8aa8-57a969415df6 req-5cce7f0c-65ba-40fb-8be9-e1f59d0464b2 service nova] Enqueued Resource ID: 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 with Priority: HIGHEST for action port [ 1140.140154] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_rules [ 1140.141644] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1140.141800] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 with Priority: HIGHEST for action port [ 1140.142268] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.142268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.142390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.142587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.142669] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.143552] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.143669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.143736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.143907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.144064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.144159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.144220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.144410] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.144438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.144528] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.145330] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.145446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.145645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.145828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.145928] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc9cb05-0d28-4a57-9cad-06d453fbd1b4',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.415497] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.415662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.415864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.415933] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.416146] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.416371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.416371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.416524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.416639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.416759] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.416847] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.416938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.417056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.417203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.417298] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.417412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.417493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.417616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.417683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.417785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.417880] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.648190] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.648345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.648899] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.649842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 with status ACTIVE [ 1140.649960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.650041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.650123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.650435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.650435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.650887] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.650887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.650887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.650887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.651089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.651188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.651261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.651308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.651412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.651490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.651569] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cc9cb05-0d28-4a57-9cad-06d453fbd1b4 is going to be updated. [ 1140.683091] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.683091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.683091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.683339] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.683403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.683567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc9cb05-0d28-4a57-9cad-06d453fbd1b4" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.820628] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1140.820821] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.821095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.821412] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.821687] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.821867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.821955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.822168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.822299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.822397] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.920455] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5bcf33c2-ef1a-4c31-9cc7-939110cde89e: rpc.has_security_group_logging(os_id): False [ 1140.940687] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.940875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.940951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.941252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.941344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.941574] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.941683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.941765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.941925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.942013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.942223] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.942304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.942381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.942527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.942653] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.942814] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.942903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.942973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.943114] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.943206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.943312] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e is going to be created. [ 1141.006476] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.006647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.006688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.007172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.007172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.019021] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e in Status: IN_PROGRESS for 2s [ 1141.044923] env[65087]: INFO networking_nsxv3.common.synchronization [req-f8f22126-4a47-4d4d-94b5-70a7cc09ade1 req-ecad2bca-7940-4f23-92c9-27bd6fb14f06 tempest-ServerRescueNegativeTestJSON-853652026 tempest-ServerRescueNegativeTestJSON-853652026-project-member] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 1141.045987] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGHEST for action security_group_members [ 1141.046257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.046470] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.046630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.046921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.047179] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.047325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.047444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.047625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.047719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.047819] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.154094] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.324850] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.551383] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.551541] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.551591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.551819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.551987] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.552126] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.552224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.552328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.552441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.552547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.552602] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be updated. [ 1141.579236] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.579408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.579463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.579673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.579822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.589398] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: IN_PROGRESS for 2s [ 1141.656585] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.656803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.656803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.657026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.657122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.657228] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1141.825995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.825995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.825995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.825995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.825995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.825995] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1141.828790] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.938793] env[65087]: INFO networking_nsxv3.common.synchronization [req-e1c85b56-3b54-42ca-bd0d-e9dca3491e2a req-05203e50-c6e4-4e70-aa4d-0e11f5dd3283 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_members [ 1141.939518] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGHEST for action security_group_members [ 1141.939878] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-664c49c8-8d39-49fa-b67a-7036d944867d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.940010] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.940082] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.940312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.940502] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.940618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.940685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.940853] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.940937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.941041] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.332355] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.332566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.332647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.332864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.332988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.333112] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1142.372701] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.372920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.373060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.373325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.373520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.383667] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1142.443326] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.443523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.443609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.443830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.443936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.444172] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.444292] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.444426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.444518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.444648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.444711] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664c49c8-8d39-49fa-b67a-7036d944867d is going to be updated. [ 1142.477045] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.477247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.477318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.477549] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.477720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.488275] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664c49c8-8d39-49fa-b67a-7036d944867d in Status: IN_PROGRESS for 2s [ 1143.034906] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e in Status: SUCCESS [ 1143.035310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.602028] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 in Status: SUCCESS [ 1143.602028] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 deletion is rescheduled due to dependency. [ 1143.602028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.706708] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1143.706924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.707105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.707327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.707591] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.707732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.707800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.707959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.708050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.708137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.708226] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.210712] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.211109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.211109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.211190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.211338] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.211442] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.211506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.211655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.211741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.211828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.211975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.212085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.212147] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.212287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.212420] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.212510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.212572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.212706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.212782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.212863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.212951] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.394149] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1144.394631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.394631] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.394784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.394996] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.395167] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.395236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.395543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.395655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.395773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.395879] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.498578] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 664c49c8-8d39-49fa-b67a-7036d944867d in Status: SUCCESS [ 1144.498578] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 664c49c8-8d39-49fa-b67a-7036d944867d deletion is rescheduled due to dependency. [ 1144.498578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.716117] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 078ba4a4-0e86-4b25-838d-1fc110729dbd: rpc.has_security_group_logging(os_id): False [ 1144.736720] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.737131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.737131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.737354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.737512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.737725] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.737856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.737950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.738145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.738591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.738591] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.738591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.738591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.738828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.738828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.739076] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.739192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.739255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.739435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.739550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.739841] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1144.838245] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.838245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.838385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.838660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.838870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.853858] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1144.898496] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.898646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.898762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.898955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.899170] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.899314] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.899396] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.899503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.899594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.899675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.899825] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.899927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.899963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.900104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.900242] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.900357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.900391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.900525] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.900617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.900682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.900761] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.013229] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-772 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.013478] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.013564] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.013861] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.014151] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.014308] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.014426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.015124] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.015285] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.015764] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.015931] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.016060] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.016173] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.016291] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.016398] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.016540] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.036587] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.036740] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1145.036874] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.037061] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-772" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.037397] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.037665] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.037853] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.038127] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.038305] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbcb86ef-0454-48b0-919d-ffda6aa01f7b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.403620] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f55d553-c00f-4d69-9855-eb76f08469ec: rpc.has_security_group_logging(os_id): False [ 1145.422274] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.422430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.422537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.422717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.422810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.423048] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.423150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.423213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.423367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.423444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.423652] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.423765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.423830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.424029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.424076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.424282] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.424341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.424389] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.424542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.424585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.424673] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1145.495057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.495057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.495057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.495057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.495057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.510412] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1145.541118] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.541369] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.541545] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.542279] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.542279] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.542543] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.542543] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.542740] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.542886] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.543040] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.543331] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.543499] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.543617] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.543912] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.544206] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.544289] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: dbcb86ef-0454-48b0-919d-ffda6aa01f7b is going to be updated. [ 1145.580980] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.581235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.581359] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.581684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.581980] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.582239] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.277276] env[65087]: INFO networking_nsxv3.common.synchronization [req-4e86220a-fcdf-4aaa-a54d-d08551f53593 req-77bb0618-b021-4bee-9d80-888af2a89ac9 service nova] Enqueued Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_rules [ 1146.277638] env[65087]: INFO networking_nsxv3.common.synchronization [req-4e86220a-fcdf-4aaa-a54d-d08551f53593 req-77bb0618-b021-4bee-9d80-888af2a89ac9 service nova] Enqueued Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_members [ 1146.277859] env[65087]: INFO networking_nsxv3.common.synchronization [req-4e86220a-fcdf-4aaa-a54d-d08551f53593 req-77bb0618-b021-4bee-9d80-888af2a89ac9 service nova] Enqueued Resource ID: dbcb86ef-0454-48b0-919d-ffda6aa01f7b with Priority: HIGHEST for action port [ 1146.278883] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_rules [ 1146.278883] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_members [ 1146.278883] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbcb86ef-0454-48b0-919d-ffda6aa01f7b with Priority: HIGHEST for action port [ 1146.279153] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.279276] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.279342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.279575] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.279701] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.280584] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.280715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.280785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.280958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.281128] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.281224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.281288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.281425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.281534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.281632] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.282385] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.282701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.282701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.282757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.282796] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbcb86ef-0454-48b0-919d-ffda6aa01f7b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.784469] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.784787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.784827] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.785785] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbcb86ef-0454-48b0-919d-ffda6aa01f7b with status ACTIVE [ 1146.785967] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.786088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.786156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.786360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.786452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.786653] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.786709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.786774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.786922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.786994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.787427] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.787645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.787797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.787948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.788076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.788192] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbcb86ef-0454-48b0-919d-ffda6aa01f7b is going to be updated. [ 1146.811402] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.811585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.811632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.811892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.812091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.812288] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbcb86ef-0454-48b0-919d-ffda6aa01f7b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.869280] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1146.869521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.290815] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.524534] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1147.524805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.793276] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.793570] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.793570] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.794071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.794071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.794071] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 is going to be updated. [ 1147.827014] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.827218] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.827311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.827967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.828155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.839397] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: IN_PROGRESS for 2s [ 1149.240253] env[65087]: INFO networking_nsxv3.common.synchronization [req-73ee9a84-e51a-4d8d-9e77-cbbf9011770e req-f0716c8d-a8e2-4cbc-8d5e-f7f82aed8618 tempest-InstanceActionsNegativeTestJSON-1586907394 tempest-InstanceActionsNegativeTestJSON-1586907394-project-member] Enqueued Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGHEST for action security_group_members [ 1149.240858] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGHEST for action security_group_members [ 1149.241228] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.241376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.241444] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.241733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.241835] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.241908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.241974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.242139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.242228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.242335] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.745497] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.745688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.746751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.746751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.746751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.746751] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.746751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.746751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.746751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.746751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.746751] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e is going to be updated. [ 1149.774943] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.775149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.775192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.775373] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.775540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.784406] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e in Status: IN_PROGRESS for 2s [ 1149.849191] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: SUCCESS [ 1149.849464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.849651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.849873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.850099] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.850233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.850315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.850497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.850594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.850708] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.850846] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.353553] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.855587] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8285264-bd0f-4381-9dd8-8b3192b9b544: rpc.has_security_group_logging(os_id): False [ 1150.875361] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.875531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.875594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.875790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.893998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.894312] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.894430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.894497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.894693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.894781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.894869] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 is going to be updated. [ 1150.966740] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.966918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.966997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.967262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.967429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.980118] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: IN_PROGRESS for 2s [ 1151.336994] env[65087]: INFO networking_nsxv3.common.synchronization [req-7878c4c6-d411-4c2d-a325-524e0b77104e req-67194de9-76a8-4d04-a341-97692c12ae69 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1151.337099] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1151.337448] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.337620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.337747] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.338026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.338422] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.338422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.338538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.338663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.338756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.338855] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.796296] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e in Status: SUCCESS [ 1151.796620] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e deletion is rescheduled due to dependency. [ 1151.796768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.842023] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.346078] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.847509] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.847926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.847926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.848030] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.848128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.848214] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1152.881941] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.882110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.882188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.882425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.882577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.892134] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1152.994853] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: SUCCESS [ 1152.995143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.741087] env[65087]: INFO networking_nsxv3.common.synchronization [None req-f2535014-1e8c-4c0b-8afa-0039844c37f5 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_rules [ 1154.743238] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_rules [ 1154.743238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecf728b1-675c-48f4-b478-180e8f5f4a76 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.743238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.743238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.743238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.743787] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.857019] env[65087]: INFO networking_nsxv3.common.synchronization [None req-911b82ce-364f-43a4-b8c9-fddbfdc85761 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_rules [ 1154.857771] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_rules [ 1154.858236] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecf728b1-675c-48f4-b478-180e8f5f4a76 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.858357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.903604] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1154.903902] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.268029] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.268029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.268029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.268029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.269550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.269550] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 already deleted. [ 1155.269550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.269550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.269550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.269550] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.790505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.791528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.791528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.791528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.791528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.791528] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 already deleted. [ 1155.791528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.484426] env[65087]: INFO networking_nsxv3.common.synchronization [req-63efd150-d82d-429a-978c-0b29622da1d5 req-ddf83e34-c15f-4ef7-ad96-3db2447a73b2 tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1156.485850] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1156.485985] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.486176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.486381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.486555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.487256] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.487256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.487256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.487256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.488165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.488845] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.918352] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.918659] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.918777] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.919073] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.919501] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.919755] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.919878] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.920263] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.920473] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.921048] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.921048] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1156.922192] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1156.922192] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1156.922192] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1156.922192] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1156.922192] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1156.943515] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1156.943842] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1156.944146] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1156.944372] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.944743] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-b55d4170-61b8-475c-835e-94d04a28bd86 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.944955] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-b55d4170-61b8-475c-835e-94d04a28bd86" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.945152] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-b55d4170-61b8-475c-835e-94d04a28bd86" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.945556] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-b55d4170-61b8-475c-835e-94d04a28bd86" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.945698] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b55d4170-61b8-475c-835e-94d04a28bd86',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.991836] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.992047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.992111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.992341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.992433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.992756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.992913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.993013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.993202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.993338] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.993433] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1157.030170] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.030366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.030451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.030740] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.030894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.041249] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1157.448886] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.449332] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.449502] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.449894] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.450215] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.450433] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port b55d4170-61b8-475c-835e-94d04a28bd86 not found, creating... [ 1157.450806] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.451016] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.451161] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.451497] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.451690] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.452059] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.452250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.452387] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.452678] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.452891] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.453085] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: b55d4170-61b8-475c-835e-94d04a28bd86 is going to be created. [ 1157.476829] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.477105] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.477249] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.477566] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.477880] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.478166] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-b55d4170-61b8-475c-835e-94d04a28bd86" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.171890] env[65087]: INFO networking_nsxv3.common.synchronization [req-63efd150-d82d-429a-978c-0b29622da1d5 req-eded6bf9-8a5f-40b4-8c33-ef08d227bff5 service nova] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 1158.172218] env[65087]: INFO networking_nsxv3.common.synchronization [req-63efd150-d82d-429a-978c-0b29622da1d5 req-eded6bf9-8a5f-40b4-8c33-ef08d227bff5 service nova] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1158.172218] env[65087]: INFO networking_nsxv3.common.synchronization [req-63efd150-d82d-429a-978c-0b29622da1d5 req-eded6bf9-8a5f-40b4-8c33-ef08d227bff5 service nova] Enqueued Resource ID: b55d4170-61b8-475c-835e-94d04a28bd86 with Priority: HIGHEST for action port [ 1158.172674] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 1158.172817] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1158.172930] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b55d4170-61b8-475c-835e-94d04a28bd86 with Priority: HIGHEST for action port [ 1158.173229] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.173363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.173426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.173625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.173760] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.174947] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.175057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.175324] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b55d4170-61b8-475c-835e-94d04a28bd86 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.175465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b55d4170-61b8-475c-835e-94d04a28bd86" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.175465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b55d4170-61b8-475c-835e-94d04a28bd86" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.175676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b55d4170-61b8-475c-835e-94d04a28bd86" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.175798] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b55d4170-61b8-475c-835e-94d04a28bd86',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.629199] env[65087]: INFO networking_nsxv3.common.synchronization [req-c700b21f-343e-4f66-aa60-bb02c08d12d2 req-5a4e13a5-3145-48c3-bb4e-e7b9b920f53b tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1158.629753] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1158.630114] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.630239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.630306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.630521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.630790] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.630901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.630964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.631135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.631220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.631311] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.678484] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.678635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.678795] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b55d4170-61b8-475c-835e-94d04a28bd86 with status ACTIVE [ 1158.678963] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.679073] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.679153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.679366] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.679458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.679624] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.679720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.679781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.679928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.680180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.680399] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.680508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.680595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.680768] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.680850] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.680972] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b55d4170-61b8-475c-835e-94d04a28bd86 is going to be updated. [ 1158.704191] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.704191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.704191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.704191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.704191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.704191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b55d4170-61b8-475c-835e-94d04a28bd86" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.050910] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1159.051147] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 deletion is rescheduled due to dependency. [ 1159.051267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.051427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.051644] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.051853] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.051975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.052049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.052217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.052295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.052387] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.133412] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.554374] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.635584] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.057667] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.138254] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.138440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.138539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.138798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.138898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.139009] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 is going to be updated. [ 1160.173099] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.173346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.173432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.173656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.173882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.188224] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: IN_PROGRESS for 2s [ 1160.563397] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.563397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.563397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.563864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.563864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.563864] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1160.593595] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.593796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.593849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.594203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.594336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.603564] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1162.199160] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: SUCCESS [ 1162.199503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.615100] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1162.615312] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.615491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.615762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.615974] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.616119] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.616451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.616451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.616451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.616543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.616650] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.809126] env[65087]: INFO networking_nsxv3.common.synchronization [req-6de0a73a-46e8-41f7-a18a-dde7a8e2ef35 req-a4b607a9-397e-4970-9136-bf877155ff96 tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1162.809674] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1162.809985] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.810117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.810186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.810392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.810579] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.810682] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.810748] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.810907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.811023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.811121] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.111992] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-810 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.111992] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.112261] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.112321] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.112546] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.112694] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.112844] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.113059] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.113212] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.113418] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.113532] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.113639] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.113748] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.113858] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.113973] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.114128] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.118740] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.134416] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.134579] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1163.134719] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.134942] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-810" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.135290] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-4573b3b8-21d8-4f5e-8547-2c9d6477b406 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.135466] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-4573b3b8-21d8-4f5e-8547-2c9d6477b406" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.135634] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-4573b3b8-21d8-4f5e-8547-2c9d6477b406" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.136032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-4573b3b8-21d8-4f5e-8547-2c9d6477b406" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.136171] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4573b3b8-21d8-4f5e-8547-2c9d6477b406',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.313610] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.313610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.313610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.314064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.314064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.314209] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.314337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.314430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.314634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.314780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.314853] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1163.344947] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.345175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.345225] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.345564] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.345716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.356130] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1163.621553] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3411048-5318-4245-bd13-ad8c65f4de91: rpc.has_security_group_logging(os_id): False [ 1163.639905] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.640092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.640092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.640304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.640399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.640675] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.640763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.640828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.641098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.641245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.641350] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1163.642779] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.643169] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.643259] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.643566] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.643791] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.644024] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 4573b3b8-21d8-4f5e-8547-2c9d6477b406 not found, creating... [ 1163.644381] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.644590] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.644725] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.644967] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.645139] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.645427] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.645582] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.645826] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.646160] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.646346] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.646534] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 4573b3b8-21d8-4f5e-8547-2c9d6477b406 is going to be created. [ 1163.667982] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.668275] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.668426] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.668898] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.669168] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.669405] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-4573b3b8-21d8-4f5e-8547-2c9d6477b406" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.711931] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.712115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.712190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.712555] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.712712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.727842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1164.379701] env[65087]: INFO networking_nsxv3.common.synchronization [req-6de0a73a-46e8-41f7-a18a-dde7a8e2ef35 req-50414226-7db2-4c02-94ed-295626f2b80e service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 1164.379701] env[65087]: INFO networking_nsxv3.common.synchronization [req-6de0a73a-46e8-41f7-a18a-dde7a8e2ef35 req-50414226-7db2-4c02-94ed-295626f2b80e service nova] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1164.380081] env[65087]: INFO networking_nsxv3.common.synchronization [req-6de0a73a-46e8-41f7-a18a-dde7a8e2ef35 req-50414226-7db2-4c02-94ed-295626f2b80e service nova] Enqueued Resource ID: 4573b3b8-21d8-4f5e-8547-2c9d6477b406 with Priority: HIGHEST for action port [ 1164.380321] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_rules [ 1164.380498] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1164.380569] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4573b3b8-21d8-4f5e-8547-2c9d6477b406 with Priority: HIGHEST for action port [ 1164.380852] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.380972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.381099] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.381253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.381330] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.383262] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.383403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.383552] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-4573b3b8-21d8-4f5e-8547-2c9d6477b406 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.383642] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4573b3b8-21d8-4f5e-8547-2c9d6477b406" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.383710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4573b3b8-21d8-4f5e-8547-2c9d6477b406" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.383906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4573b3b8-21d8-4f5e-8547-2c9d6477b406" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.383984] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4573b3b8-21d8-4f5e-8547-2c9d6477b406',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.885500] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.885684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.887051] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4573b3b8-21d8-4f5e-8547-2c9d6477b406 with status ACTIVE [ 1164.887288] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.887454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.887537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.887811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.887916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.888535] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.888535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.888535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.888535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.888535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.888875] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.888875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.888957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.889112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.889157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.889223] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4573b3b8-21d8-4f5e-8547-2c9d6477b406 is going to be updated. [ 1164.928597] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.928756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.928843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.929078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.929224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.929388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4573b3b8-21d8-4f5e-8547-2c9d6477b406" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.366808] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1165.366997] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1165.367127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.367291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.367508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.367695] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.367873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.367952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.368190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.368326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.368467] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.741367] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1165.741761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.871215] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.374238] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.882417] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.882417] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.883988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.883988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.883988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.883988] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1166.914357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.914510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.914573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.914800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.914948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.926058] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1166.970040] env[65087]: INFO networking_nsxv3.common.synchronization [req-6a2af8d4-99be-412b-b8ad-a888fdbaede0 req-d0867e8c-692c-43f8-841e-ea432bf02dc1 tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_members [ 1166.973151] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_members [ 1166.973151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecf728b1-675c-48f4-b478-180e8f5f4a76 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.973151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.973151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.973151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.973151] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.973151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.973151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.973151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.973151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.973151] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.325146] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.325146] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.325146] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.325390] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.325579] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.325937] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.326166] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.326409] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.326565] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.326776] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1167.326887] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.326992] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.327118] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.327226] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1167.327329] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.327466] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.347842] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.348028] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1167.348181] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.348391] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-525" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.348743] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-391a8407-5f42-4636-829d-5c16e31d7713 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.348930] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-391a8407-5f42-4636-829d-5c16e31d7713" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.349151] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-391a8407-5f42-4636-829d-5c16e31d7713" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.349397] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-391a8407-5f42-4636-829d-5c16e31d7713" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.349539] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('391a8407-5f42-4636-829d-5c16e31d7713',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.477421] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.477421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.477421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.477421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.477421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.477421] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.477421] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.477855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.477855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.477855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.477855] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 already deleted. [ 1167.477855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.854372] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.854655] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.854810] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.855146] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.855337] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.855514] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 391a8407-5f42-4636-829d-5c16e31d7713 not found, creating... [ 1167.856013] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.856232] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.856356] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.856608] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.856748] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.857053] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.857228] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.857345] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.857570] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.857705] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.857916] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 391a8407-5f42-4636-829d-5c16e31d7713 is going to be created. [ 1167.878971] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.879360] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.879565] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.879871] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.880155] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.880407] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-391a8407-5f42-4636-829d-5c16e31d7713" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.624479] env[65087]: INFO networking_nsxv3.common.synchronization [req-6a2af8d4-99be-412b-b8ad-a888fdbaede0 req-207147f7-9432-4b02-add5-a1351979f861 service nova] Enqueued Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_rules [ 1168.624904] env[65087]: INFO networking_nsxv3.common.synchronization [req-6a2af8d4-99be-412b-b8ad-a888fdbaede0 req-207147f7-9432-4b02-add5-a1351979f861 service nova] Enqueued Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_members [ 1168.624904] env[65087]: INFO networking_nsxv3.common.synchronization [req-6a2af8d4-99be-412b-b8ad-a888fdbaede0 req-207147f7-9432-4b02-add5-a1351979f861 service nova] Enqueued Resource ID: 391a8407-5f42-4636-829d-5c16e31d7713 with Priority: HIGHEST for action port [ 1168.625398] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_rules [ 1168.625524] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_members [ 1168.625665] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 391a8407-5f42-4636-829d-5c16e31d7713 with Priority: HIGHEST for action port [ 1168.626020] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecf728b1-675c-48f4-b478-180e8f5f4a76 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.626328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.626411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.626606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.626682] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.628468] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecf728b1-675c-48f4-b478-180e8f5f4a76 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.628468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.628468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.629059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.629059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.629059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.629059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.629302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.629302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.629302] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.630805] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-391a8407-5f42-4636-829d-5c16e31d7713 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.630927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-391a8407-5f42-4636-829d-5c16e31d7713" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.630927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-391a8407-5f42-4636-829d-5c16e31d7713" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.631091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-391a8407-5f42-4636-829d-5c16e31d7713" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.631407] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('391a8407-5f42-4636-829d-5c16e31d7713',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.936796] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1168.936796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.937050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.937102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.937313] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.937435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.937502] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.937663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.937746] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.937992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.937992] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.129215] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecf728b1-675c-48f4-b478-180e8f5f4a76 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.129346] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.131732] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.133535] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 391a8407-5f42-4636-829d-5c16e31d7713 with status ACTIVE [ 1169.133735] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.133936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.133936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.134148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.134239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.134418] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.134513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.134566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.134722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.134833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.134969] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.135094] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.135265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.135335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.135397] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.135484] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 391a8407-5f42-4636-829d-5c16e31d7713 is going to be updated. [ 1169.157102] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.157293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.157293] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.157505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.157637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.157857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-391a8407-5f42-4636-829d-5c16e31d7713" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.440266] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.440443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.440487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.440704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.440866] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.441408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.441482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.441643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.441763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.441898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.442094] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.442195] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.442258] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.442400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.442538] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.442628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.442718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.442817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.442899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.442970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.443073] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.634494] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.945333] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4986f406-ffa8-458b-a142-64bc589ad53b: rpc.has_security_group_logging(os_id): False [ 1169.963205] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.963364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.963437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.963660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.963769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.963995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.964106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.964190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.964377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.964458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.964642] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.964750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.964844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.965070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.965153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.965348] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.965446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.965509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.965650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.965725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.965830] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1170.029873] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.030240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.030240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.030487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.030839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.071717] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1170.136472] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.136668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.136668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.136900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.136992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.137109] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 is going to be created. [ 1170.176457] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.176651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.176698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.176891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.177074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.187209] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 in Status: UNINITIALIZED for 2s [ 1172.088468] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1172.088832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.198427] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 in Status: SUCCESS [ 1172.198652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.198870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.199097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.199303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.199422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.199512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.199676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.199782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.199877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.199973] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.702558] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.205486] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ecf728b1-675c-48f4-b478-180e8f5f4a76: rpc.has_security_group_logging(os_id): False [ 1173.224687] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.224909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.224983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.225241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.225357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.225636] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.225758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.225858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.226055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.226168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.226271] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 is going to be created. [ 1173.290973] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.291117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.291117] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.291422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.291953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.304455] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 in Status: IN_PROGRESS for 2s [ 1173.518414] env[65087]: INFO networking_nsxv3.common.synchronization [req-8a0bc4c7-ee51-46ea-87c6-a34e2bb30f29 req-734d41b3-80f2-4e35-81c4-b3d85f1f0d7f tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1173.519898] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGHEST for action security_group_members [ 1173.520424] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.520527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.520571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.520801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.521677] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.521677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.521677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.521677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.521677] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.521677] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.023914] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.024089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.024165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.024453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.024513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.024847] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.024847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.024937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.025021] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.025105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.025193] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 is going to be updated. [ 1174.051887] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.052144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.052144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.052343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.052485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.061631] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: IN_PROGRESS for 2s [ 1175.317550] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 in Status: SUCCESS [ 1175.317937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.634217] env[65087]: INFO networking_nsxv3.common.synchronization [req-93779eeb-1253-47d3-8888-40a8837d4526 req-e3cf2a74-8946-46f4-89d7-ce12bcaccc79 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1175.634835] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1175.635227] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.635377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.635452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.635711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.635901] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.636041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.636115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.636398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.636398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.636487] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.011032] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.011032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.011032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.011032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.011032] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.011032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.011032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.011032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.011032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.011608] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.011874] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1176.012140] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1176.012388] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1176.012742] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1176.013524] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1176.013524] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1176.032221] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1176.032412] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1176.032548] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1176.032719] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.033026] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.033202] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.033325] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.033661] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.033798] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2dce91-04d6-44a8-9fbc-5b2cd7152345',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.070616] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 in Status: SUCCESS [ 1176.070616] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 deletion is rescheduled due to dependency. [ 1176.070616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.140316] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.535961] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.536388] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.536388] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.536586] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.536739] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.536897] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port ee2dce91-04d6-44a8-9fbc-5b2cd7152345 not found, creating... [ 1176.537167] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.537328] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.537443] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.537663] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.537802] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.538157] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.538315] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.538432] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.538636] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.538768] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.538904] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: ee2dce91-04d6-44a8-9fbc-5b2cd7152345 is going to be created. [ 1176.560212] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.560433] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.560527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.560786] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.561024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.561254] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.641977] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.144648] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.144906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.145166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.145439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.145577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.146183] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1177.181433] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.181593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.181674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.181896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.182065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.201647] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1177.307471] env[65087]: INFO networking_nsxv3.common.synchronization [req-93779eeb-1253-47d3-8888-40a8837d4526 req-2aad8996-53b9-4c25-9e83-dc968fb14c78 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1177.307748] env[65087]: INFO networking_nsxv3.common.synchronization [req-93779eeb-1253-47d3-8888-40a8837d4526 req-2aad8996-53b9-4c25-9e83-dc968fb14c78 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1177.308032] env[65087]: INFO networking_nsxv3.common.synchronization [req-93779eeb-1253-47d3-8888-40a8837d4526 req-2aad8996-53b9-4c25-9e83-dc968fb14c78 service nova] Enqueued Resource ID: ee2dce91-04d6-44a8-9fbc-5b2cd7152345 with Priority: HIGHEST for action port [ 1177.309606] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1177.309793] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1177.310202] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2dce91-04d6-44a8-9fbc-5b2cd7152345 with Priority: HIGHEST for action port [ 1177.310275] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.310449] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.310539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.310758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.310859] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.312022] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.312801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.313279] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.313279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.313279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.313500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.313637] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee2dce91-04d6-44a8-9fbc-5b2cd7152345',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.596958] env[65087]: INFO networking_nsxv3.common.synchronization [None req-8be8a41e-029c-4b26-a8f9-fd9796c928e0 tempest-AttachInterfacesTestJSON-625617837 tempest-AttachInterfacesTestJSON-625617837-project-member] Enqueued Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1177.597769] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd with Priority: HIGHEST for action security_group_members [ 1177.598127] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-078ba4a4-0e86-4b25-838d-1fc110729dbd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.598456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.598456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.598565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.598668] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.598767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.598832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.599011] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.599115] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.599211] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('078ba4a4-0e86-4b25-838d-1fc110729dbd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.816807] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.816807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.816807] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee2dce91-04d6-44a8-9fbc-5b2cd7152345 with status ACTIVE [ 1177.817157] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.817157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.817157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.819098] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.819098] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.819098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.819098] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee2dce91-04d6-44a8-9fbc-5b2cd7152345 is going to be updated. [ 1177.846220] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.846378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.846451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.846690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.846836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.847129] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee2dce91-04d6-44a8-9fbc-5b2cd7152345" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.101462] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.101462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.101655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.102203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.102203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.102203] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.102363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.102363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.102523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.103056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.103056] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd is going to be updated. [ 1178.147695] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.148056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.148131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.148307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.148466] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.160151] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: IN_PROGRESS for 2s [ 1179.212093] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1179.212482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.212482] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.213337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.213337] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.213337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.213337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.213337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.213337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.213607] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.715907] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.906026] env[65087]: INFO networking_nsxv3.common.synchronization [req-f7f7e168-194b-438c-9bb7-f38cb94fc183 req-b242215b-b0df-43bf-97ce-01290ed0e974 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 1179.906257] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 1179.906765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.908841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.909479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.909908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.910582] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.910893] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.911038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.911299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.911471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.911840] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.171133] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd in Status: SUCCESS [ 1180.171332] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 078ba4a4-0e86-4b25-838d-1fc110729dbd deletion is rescheduled due to dependency. [ 1180.171446] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-078ba4a4-0e86-4b25-838d-1fc110729dbd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.218425] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.414575] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.722977] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.723357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.723452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.723697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.723844] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.723881] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1180.763188] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.763383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.763383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.763567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.763712] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.773946] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1180.918081] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.421586] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.421935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.421935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.422249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.422419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.422609] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be updated. [ 1181.463126] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.463126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.463126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.463335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.463335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.479741] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: IN_PROGRESS for 2s [ 1182.784977] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1182.785327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.785382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.786188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.786381] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.786537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.786613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.786845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.786952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.787352] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.787489] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.041283] env[65087]: INFO networking_nsxv3.common.synchronization [req-4d478266-7182-45fd-9a01-577369e11a80 req-f3173f9e-2010-4ed3-b23b-0dfc9c8cb4f6 tempest-ServerActionsTestOtherB-1688726736 tempest-ServerActionsTestOtherB-1688726736-project-member] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1183.041955] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1183.042381] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.042513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.042582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.042792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.042957] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.043257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.043667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.043870] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.043966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.044075] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.291064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.291407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.291407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.291693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.291978] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.292202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.292202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.292490] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.292599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.292822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.293208] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.293208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.293299] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.293514] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.293801] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.293942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.294064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.294330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.294395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.294507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.294650] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.343365] env[65087]: INFO networking_nsxv3.common.synchronization [None req-6b0352a7-8390-444d-a694-4fb13cae110d None None] Enqueued Resource ID: bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2 with Priority: HIGHEST for action port [ 1183.344610] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2 with Priority: HIGHEST for action port [ 1183.345198] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.345198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.345198] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.345462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.345509] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.488342] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: SUCCESS [ 1183.488941] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.547026] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.547026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.547242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.547544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.567772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.568076] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.568269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.568374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.568589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.568675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.568770] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1183.593959] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.594123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.594196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.594398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.594547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.603276] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1183.797092] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f55d553-c00f-4d69-9855-eb76f08469ec: rpc.has_security_group_logging(os_id): False [ 1183.817393] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.817554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.817666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.817949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.818134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.818363] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.818476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.818544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.818705] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.818784] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.818995] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.819175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.819241] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.819383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.819461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.819650] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.819750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.819852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.820035] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.820122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.820214] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1183.848380] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2 [ 1183.848637] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.848861] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.848938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.849582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.849582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.849582] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2 already deleted. [ 1183.850100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc6eab33-078b-48d8-b2e2-4b9eb6cfccd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.894176] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.894176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.894462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.894594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.894815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.911774] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1185.618059] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1185.618426] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a deletion is rescheduled due to dependency. [ 1185.618426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.927283] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1185.927511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.095197] env[65087]: INFO networking_nsxv3.common.synchronization [None req-b1c80b79-250f-4f0d-934a-64c266e48b1b None None] Enqueued Resource ID: c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67 with Priority: HIGHEST for action port [ 1186.095760] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67 with Priority: HIGHEST for action port [ 1186.096121] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.096248] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.096308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.096579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.096671] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.599164] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67 [ 1186.599164] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.599323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.599418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.599659] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.599780] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.599886] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67 already deleted. [ 1186.599968] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0693cfb-b0e1-459e-b8f7-e2ee67f0ad67" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.924608] env[65087]: INFO networking_nsxv3.common.synchronization [req-f9bf9562-6345-4924-aea9-28c7973e9647 req-a5850583-9f60-488d-96e1-e2f568b00e88 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1187.924932] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1187.925275] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.925398] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.925479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.925685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.925843] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.925945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.926026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.926203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.926294] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.926427] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.428594] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.555456] env[65087]: INFO networking_nsxv3.common.synchronization [req-b0e48fa6-6225-441b-a17d-8c199c0e05b8 req-15c15f4a-3727-4739-abe1-0758a4709904 tempest-ServerMetadataNegativeTestJSON-1947628058 tempest-ServerMetadataNegativeTestJSON-1947628058-project-member] Enqueued Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGHEST for action security_group_members [ 1188.556394] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGHEST for action security_group_members [ 1188.556729] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d83079-ca61-42cb-b6f4-fd429feaca4e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.556900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.556900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.557328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.557512] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.557619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.557667] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.557820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.557906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.558008] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.902064] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-937 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.902274] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-937" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.902500] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-937" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.902879] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-937" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.903329] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.903600] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.903808] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.904161] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.904417] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.904747] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.904947] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.905171] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.905393] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.905614] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.905786] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.905973] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.926054] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.926372] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1188.926372] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.926523] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-937" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.926826] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-f8c0bf19-521d-447a-bce5-9554d7dcefe2 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.926992] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-f8c0bf19-521d-447a-bce5-9554d7dcefe2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.927125] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-f8c0bf19-521d-447a-bce5-9554d7dcefe2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.927429] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-f8c0bf19-521d-447a-bce5-9554d7dcefe2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.927625] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8c0bf19-521d-447a-bce5-9554d7dcefe2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.932634] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.060125] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.060268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.060372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.060616] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.060716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.060916] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.061028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.061095] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.061257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.061340] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.061424] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e already deleted. [ 1189.061504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.431104] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.431104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.431104] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.432484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.432484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.432484] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port f8c0bf19-521d-447a-bce5-9554d7dcefe2 not found, creating... [ 1189.432484] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.432484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.432484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.432484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.432484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.432934] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.432934] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.432934] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.433208] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.433284] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.433420] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: f8c0bf19-521d-447a-bce5-9554d7dcefe2 is going to be created. [ 1189.434670] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.434801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.434861] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.434996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.435090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.435176] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1189.456080] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.456309] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.456434] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.456718] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.457027] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.457192] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-f8c0bf19-521d-447a-bce5-9554d7dcefe2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.464458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.464661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.464778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.465087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.465380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.474434] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1190.147192] env[65087]: INFO networking_nsxv3.common.synchronization [req-b0e48fa6-6225-441b-a17d-8c199c0e05b8 req-00c2c66f-5239-4c35-a6ed-82681c051317 service nova] Enqueued Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGHEST for action security_group_rules [ 1190.147493] env[65087]: INFO networking_nsxv3.common.synchronization [req-b0e48fa6-6225-441b-a17d-8c199c0e05b8 req-00c2c66f-5239-4c35-a6ed-82681c051317 service nova] Enqueued Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGHEST for action security_group_members [ 1190.147577] env[65087]: INFO networking_nsxv3.common.synchronization [req-b0e48fa6-6225-441b-a17d-8c199c0e05b8 req-00c2c66f-5239-4c35-a6ed-82681c051317 service nova] Enqueued Resource ID: f8c0bf19-521d-447a-bce5-9554d7dcefe2 with Priority: HIGHEST for action port [ 1190.148127] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGHEST for action security_group_rules [ 1190.148269] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGHEST for action security_group_members [ 1190.148369] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8c0bf19-521d-447a-bce5-9554d7dcefe2 with Priority: HIGHEST for action port [ 1190.148638] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.148761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.148828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.149142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.149217] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.150465] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d83079-ca61-42cb-b6f4-fd429feaca4e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.150465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.150465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.150465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.150737] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.150737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.150737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.150848] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.152034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.152034] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.152723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8c0bf19-521d-447a-bce5-9554d7dcefe2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.152723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8c0bf19-521d-447a-bce5-9554d7dcefe2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.152723] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8c0bf19-521d-447a-bce5-9554d7dcefe2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.152849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8c0bf19-521d-447a-bce5-9554d7dcefe2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.152849] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8c0bf19-521d-447a-bce5-9554d7dcefe2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.654534] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d83079-ca61-42cb-b6f4-fd429feaca4e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.655164] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.655164] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.657480] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8c0bf19-521d-447a-bce5-9554d7dcefe2 with status ACTIVE [ 1190.657480] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.657480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.657480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.657742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.657833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.658951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.658951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.658951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.658951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.658951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.658951] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.659430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.659430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.659430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.659430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.659676] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8c0bf19-521d-447a-bce5-9554d7dcefe2 is going to be updated. [ 1190.684445] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.684594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.684663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.684867] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.685012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.685175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8c0bf19-521d-447a-bce5-9554d7dcefe2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.157698] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.486796] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1191.486908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.660614] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.661126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.661126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.661354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.661354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.661354] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e is going to be created. [ 1191.689045] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.689045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.689045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.689045] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.689431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.698685] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e in Status: UNINITIALIZED for 2s [ 1193.598712] env[65087]: INFO networking_nsxv3.common.synchronization [req-0924aec3-0752-4558-ab84-87cabe1219cf req-1af7eda6-eb1e-4757-90b0-fe276af825b3 tempest-ServerActionsTestOtherB-1688726736 tempest-ServerActionsTestOtherB-1688726736-project-member] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1193.599450] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1193.599777] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.600032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.600032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.600189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.600342] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.600801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.600880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.601066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.601154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.601255] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.713200] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e in Status: SUCCESS [ 1193.713438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.713621] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.713862] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.714075] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.714204] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.714270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.714432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.714513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.714604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.714692] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.936551] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.936767] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.936856] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.937235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.937514] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.937672] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.937790] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.938024] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.938250] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.938466] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.938579] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.938686] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.938790] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.938919] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.939050] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.939271] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.962503] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.962708] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.962812] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.963106] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.963680] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.963868] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.963993] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.964412] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.964557] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b198e96-0aae-46f4-9cbd-aba2627f4aa3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.103303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.103534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.103534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.103760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.103856] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.104060] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.104188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.104254] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.104408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.104485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.104571] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1194.129264] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.129468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.129468] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.129661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.129801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.138166] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1194.217436] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d83079-ca61-42cb-b6f4-fd429feaca4e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.217609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.217609] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.217831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.218027] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.218194] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.218271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.218434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.218554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.218612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.218753] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d83079-ca61-42cb-b6f4-fd429feaca4e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.218847] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.218910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.219056] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.219287] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.219369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.219431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.219565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.219638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.219717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.219805] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.467516] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.467755] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.467907] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.468324] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.468498] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.468676] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 4b198e96-0aae-46f4-9cbd-aba2627f4aa3 not found, creating... [ 1194.468962] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.469136] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.469296] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.469583] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.469729] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.470015] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.470194] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.470313] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.470539] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.470671] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.470815] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 4b198e96-0aae-46f4-9cbd-aba2627f4aa3 is going to be created. [ 1194.491090] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.491357] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.491509] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.491774] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.492020] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.492263] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.722435] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7d83079-ca61-42cb-b6f4-fd429feaca4e: rpc.has_security_group_logging(os_id): False [ 1194.740596] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.740769] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.740914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.741190] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.741337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.741544] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.741655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.741761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.741883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.741962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.742229] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.742278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.742308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.742434] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.742516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.742699] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.742783] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.742830] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.742964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.743050] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.743138] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e is going to be created. [ 1194.805798] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.805962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.806046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.806255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.806551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.817608] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e in Status: IN_PROGRESS for 2s [ 1195.235567] env[65087]: INFO networking_nsxv3.common.synchronization [req-0924aec3-0752-4558-ab84-87cabe1219cf req-a4de07f4-b9a1-4036-9ecb-5d0625520237 service nova] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1195.235689] env[65087]: INFO networking_nsxv3.common.synchronization [req-0924aec3-0752-4558-ab84-87cabe1219cf req-a4de07f4-b9a1-4036-9ecb-5d0625520237 service nova] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1195.235958] env[65087]: INFO networking_nsxv3.common.synchronization [req-0924aec3-0752-4558-ab84-87cabe1219cf req-a4de07f4-b9a1-4036-9ecb-5d0625520237 service nova] Enqueued Resource ID: 4b198e96-0aae-46f4-9cbd-aba2627f4aa3 with Priority: HIGHEST for action port [ 1195.236651] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1195.236854] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1195.237043] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b198e96-0aae-46f4-9cbd-aba2627f4aa3 with Priority: HIGHEST for action port [ 1195.237489] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.237662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.237735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.238091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.238355] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.240330] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.240330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.240532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.240706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.240832] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.241106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.241188] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b198e96-0aae-46f4-9cbd-aba2627f4aa3',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.743449] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.744023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.744023] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b198e96-0aae-46f4-9cbd-aba2627f4aa3 with status ACTIVE [ 1195.744023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.744252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.744252] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.744364] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.744404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.744599] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.744690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.744770] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.744895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.744980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.745183] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.745269] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.745306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.745439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.745513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.745615] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b198e96-0aae-46f4-9cbd-aba2627f4aa3 is going to be updated. [ 1195.770487] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.770651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.770704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.770967] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.771191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.771375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b198e96-0aae-46f4-9cbd-aba2627f4aa3" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.149720] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1196.149720] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a deletion is rescheduled due to dependency. [ 1196.149720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.149720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.150142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.150142] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.150270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.150270] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.150394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.150478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.150586] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.640432] env[65087]: INFO networking_nsxv3.common.synchronization [req-c7cc261e-2210-4ec2-8859-e487e39ec25a req-d6cda9bb-dbec-4881-b2e6-5bddccfc6179 tempest-ServerActionsTestOtherA-102607237 tempest-ServerActionsTestOtherA-102607237-project-member] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 1196.640432] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGHEST for action security_group_members [ 1196.640432] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.640610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.640610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.640755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.641065] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.641065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.641065] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.641203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.641325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.641398] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.652885] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.828958] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e in Status: SUCCESS [ 1196.829407] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.145718] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.145718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.145718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.145718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.145718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.145718] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.145718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.145718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.145718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.145718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.145718] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be updated. [ 1197.154394] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.180408] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.180604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.180708] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.180934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.181136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.196195] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: IN_PROGRESS for 2s [ 1197.657260] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.657429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.657485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.657711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.657820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.657896] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1197.686102] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.686322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.686374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.686612] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.686776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.696078] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1199.205643] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: IN_PROGRESS for 4s [ 1199.706340] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1199.706556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.706722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.706935] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.707143] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.707261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.707326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.707484] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.707562] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.707645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.707735] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.782993] env[65087]: INFO networking_nsxv3.common.synchronization [req-8cce6606-49b1-4378-8776-1913243570b1 req-26c5ecec-5940-4d97-828a-09e62c6572da tempest-AttachVolumeShelveTestJSON-1249647460 tempest-AttachVolumeShelveTestJSON-1249647460-project-member] Enqueued Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_members [ 1199.783598] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 with Priority: HIGHEST for action security_group_members [ 1199.783835] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8285264-bd0f-4381-9dd8-8b3192b9b544 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.783988] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.784664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.784664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.784664] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.784664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.784664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.784886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.784886] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.785174] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8285264-bd0f-4381-9dd8-8b3192b9b544',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.209988] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.287502] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.287763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.287763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.288012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.288107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.288395] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.288547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.288636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.288878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.289109] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.289259] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 is going to be updated. [ 1200.319440] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.319686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.319686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.319908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.320064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.329904] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: IN_PROGRESS for 2s [ 1200.712858] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49706196-d349-4818-ae7e-d6615560719a: rpc.has_security_group_logging(os_id): False [ 1200.732640] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.732820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.732942] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.733247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.733399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.733763] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.733925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.734026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.734196] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.734279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.734368] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1200.795504] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.795694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.795741] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.795921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.796097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.808979] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1201.225173] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f in Status: SUCCESS [ 1201.225678] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f deletion is rescheduled due to dependency. [ 1201.225678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.408257] env[65087]: INFO networking_nsxv3.common.synchronization [req-ee990b64-10ff-4c4c-89cb-192c63c5026a req-92f848b8-fb1c-470d-b270-3e0cfa497e88 tempest-ServerMetadataNegativeTestJSON-1947628058 tempest-ServerMetadataNegativeTestJSON-1947628058-project-member] Enqueued Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGHEST for action security_group_members [ 1201.409422] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGHEST for action security_group_members [ 1201.409422] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7d83079-ca61-42cb-b6f4-fd429feaca4e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.409422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.409422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.409422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.409697] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.409697] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.409802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.409877] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.409956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.410069] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.912505] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.912710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.912758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.913022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.913238] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.913388] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.913496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.913561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.913728] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.913836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.913897] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e is going to be updated. [ 1201.939061] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.939203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.939283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.939530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.939686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.958582] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e in Status: IN_PROGRESS for 2s [ 1202.340715] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 in Status: SUCCESS [ 1202.340715] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8285264-bd0f-4381-9dd8-8b3192b9b544 deletion is rescheduled due to dependency. [ 1202.340715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8285264-bd0f-4381-9dd8-8b3192b9b544" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.822623] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1202.822859] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.007209] env[65087]: INFO networking_nsxv3.common.synchronization [req-6f68b0b0-19cf-4f3b-9273-dce6a97948ff req-ed991a6f-a947-4b9e-9982-147af5e0cf79 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1203.007487] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1203.007784] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.007907] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.007974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.008220] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.008412] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.008785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.008785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.008785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.008925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.008925] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.304579] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.304790] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.304915] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.305246] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.305513] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.305675] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.305794] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.306078] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.306235] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.306456] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1203.306570] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1203.306676] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1203.306785] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1203.306894] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1203.306999] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1203.307149] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.328064] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.328334] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1203.328502] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.328721] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.329064] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-0f254204-7a2a-4a8a-b5c0-1c71680916dc taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.329353] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-0f254204-7a2a-4a8a-b5c0-1c71680916dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.329491] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-0f254204-7a2a-4a8a-b5c0-1c71680916dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.329827] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-0f254204-7a2a-4a8a-b5c0-1c71680916dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.329971] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f254204-7a2a-4a8a-b5c0-1c71680916dc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.512835] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.832699] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.832934] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.833076] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.833361] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.833538] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.833693] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 0f254204-7a2a-4a8a-b5c0-1c71680916dc not found, creating... [ 1203.833966] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.834140] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.834257] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.834474] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.834856] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.835863] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.836053] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.836179] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.836396] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.836712] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.836864] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 0f254204-7a2a-4a8a-b5c0-1c71680916dc is going to be created. [ 1203.857963] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.857963] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.857963] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.858251] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.858592] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.858754] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-0f254204-7a2a-4a8a-b5c0-1c71680916dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.969636] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e in Status: SUCCESS [ 1203.969636] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e deletion is rescheduled due to dependency. [ 1203.969636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.015192] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.517910] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.518284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.518284] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.518439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.518534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.518633] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1204.546163] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.546388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.546388] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.546603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.546750] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.556561] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1204.585077] env[65087]: INFO networking_nsxv3.common.synchronization [req-6f68b0b0-19cf-4f3b-9273-dce6a97948ff req-a2f70dab-33c2-4517-9b9e-65a14812102e service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1204.585377] env[65087]: INFO networking_nsxv3.common.synchronization [req-6f68b0b0-19cf-4f3b-9273-dce6a97948ff req-a2f70dab-33c2-4517-9b9e-65a14812102e service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1204.585561] env[65087]: INFO networking_nsxv3.common.synchronization [req-6f68b0b0-19cf-4f3b-9273-dce6a97948ff req-a2f70dab-33c2-4517-9b9e-65a14812102e service nova] Enqueued Resource ID: 0f254204-7a2a-4a8a-b5c0-1c71680916dc with Priority: HIGHEST for action port [ 1204.586134] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1204.586295] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1204.586407] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f254204-7a2a-4a8a-b5c0-1c71680916dc with Priority: HIGHEST for action port [ 1204.586722] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.586797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.586866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.587087] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.587168] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.588073] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.588177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.588455] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f254204-7a2a-4a8a-b5c0-1c71680916dc taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.588568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f254204-7a2a-4a8a-b5c0-1c71680916dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.588665] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f254204-7a2a-4a8a-b5c0-1c71680916dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.588804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f254204-7a2a-4a8a-b5c0-1c71680916dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.588881] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f254204-7a2a-4a8a-b5c0-1c71680916dc',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.090735] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.090918] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.091057] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f254204-7a2a-4a8a-b5c0-1c71680916dc with status ACTIVE [ 1205.091246] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.091353] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.091418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.091654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.091739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.091904] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.092063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.092063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.092222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.092297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.092513] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.092635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.092674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.092861] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.092939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.093030] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f254204-7a2a-4a8a-b5c0-1c71680916dc is going to be updated. [ 1205.128024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.128024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.128024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.128024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.128024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.128024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f254204-7a2a-4a8a-b5c0-1c71680916dc" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.567680] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1206.567937] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.568096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.568453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.568657] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.568657] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.569047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.569047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.569047] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.569047] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.071143] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.574162] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.077156] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.078578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.078578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.078578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.078578] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.078578] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1208.109142] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.109315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.109376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.109579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.109730] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.124449] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1209.028485] env[65087]: INFO networking_nsxv3.common.synchronization [req-e87d2f40-3385-4a45-9101-861f0217e829 req-11b045f5-f8b6-43dd-b32c-c12dc65d3ace tempest-DeleteServersTestJSON-1640035189 tempest-DeleteServersTestJSON-1640035189-project-member] Enqueued Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1209.029109] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4986f406-ffa8-458b-a142-64bc589ad53b with Priority: HIGHEST for action security_group_members [ 1209.029635] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-4986f406-ffa8-458b-a142-64bc589ad53b taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.031084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.031201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.031428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.031643] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.031760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.031827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.032012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.032107] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.032207] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4986f406-ffa8-458b-a142-64bc589ad53b',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.534597] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.534774] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.534817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.535071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.535172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.535374] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.535505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.535598] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.535838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.535951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.536096] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b is going to be updated. [ 1209.567826] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.567992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.568046] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.568263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.568516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.577439] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: IN_PROGRESS for 2s [ 1210.133629] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1210.134134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.134134] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.134354] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.134497] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.135785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.135785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.135785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.135785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.135785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.135785] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.638534] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.638767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.638767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.639162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.639438] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.639551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.639591] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.639785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.640259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.640259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.640259] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.640259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.640483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.640483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.641212] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.641212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.641212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.641212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.641212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.641212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.641212] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.144154] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f55d553-c00f-4d69-9855-eb76f08469ec: rpc.has_security_group_logging(os_id): False [ 1211.164945] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.164945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.164945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.164945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.165266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.165266] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.165365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.165365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.165524] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.165624] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.165765] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.165866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.165916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.166069] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.166286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.166399] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.166560] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.166921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.167122] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.167206] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.167303] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1211.258052] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.258052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.258052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.258052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.258052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.280275] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1211.587627] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4986f406-ffa8-458b-a142-64bc589ad53b in Status: SUCCESS [ 1211.587914] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4986f406-ffa8-458b-a142-64bc589ad53b deletion is rescheduled due to dependency. [ 1211.588081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4986f406-ffa8-458b-a142-64bc589ad53b" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.295433] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1213.295433] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.030935] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1214.030935] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1214.277157] env[65087]: INFO networking_nsxv3.common.synchronization [None req-1df92ec7-dca7-4654-802c-db1552759da3 None None] Enqueued Resource ID: 5b5dbff6-cc81-4992-a6fe-cf4729f7fdea with Priority: HIGHEST for action port [ 1214.277860] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b5dbff6-cc81-4992-a6fe-cf4729f7fdea with Priority: HIGHEST for action port [ 1214.278240] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b5dbff6-cc81-4992-a6fe-cf4729f7fdea taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.278589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b5dbff6-cc81-4992-a6fe-cf4729f7fdea" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.278688] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b5dbff6-cc81-4992-a6fe-cf4729f7fdea" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.279131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b5dbff6-cc81-4992-a6fe-cf4729f7fdea" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.279228] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b5dbff6-cc81-4992-a6fe-cf4729f7fdea',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.781166] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b5dbff6-cc81-4992-a6fe-cf4729f7fdea [ 1214.781426] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.781634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.781634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.782106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.782106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.782106] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b5dbff6-cc81-4992-a6fe-cf4729f7fdea already deleted. [ 1214.782106] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b5dbff6-cc81-4992-a6fe-cf4729f7fdea" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.022259] env[65087]: INFO networking_nsxv3.common.synchronization [None req-3075ae94-fd5c-41d4-98d0-7f933ce7d934 tempest-AttachVolumeTestJSON-120673121 tempest-AttachVolumeTestJSON-120673121-project-member] Enqueued Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_rules [ 1215.022729] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_rules [ 1215.024226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.024462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.024595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.024995] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.025156] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.116399] env[65087]: INFO networking_nsxv3.common.synchronization [None req-4186ab87-d673-4768-96fc-ebc1c0000f9b tempest-AttachVolumeTestJSON-120673121 tempest-AttachVolumeTestJSON-120673121-project-member] Enqueued Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_rules [ 1215.116726] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_rules [ 1215.117059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.117165] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.547840] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.548075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.548152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.548762] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.549261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.549261] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 already deleted. [ 1215.549261] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.549506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.549506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.549932] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.071783] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.072086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.072086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.072345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.072460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.072814] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 already deleted. [ 1216.072976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.492834] env[65087]: INFO networking_nsxv3.common.synchronization [None req-7815492c-613d-4e09-ad93-4e5ac0178225 None None] Enqueued Resource ID: b612eb98-c678-44d5-aad6-8d38d52289dd with Priority: HIGHEST for action port [ 1216.493444] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b612eb98-c678-44d5-aad6-8d38d52289dd with Priority: HIGHEST for action port [ 1216.493780] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-b612eb98-c678-44d5-aad6-8d38d52289dd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.493926] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b612eb98-c678-44d5-aad6-8d38d52289dd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.493997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b612eb98-c678-44d5-aad6-8d38d52289dd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.494409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b612eb98-c678-44d5-aad6-8d38d52289dd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.494504] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b612eb98-c678-44d5-aad6-8d38d52289dd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.996973] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b612eb98-c678-44d5-aad6-8d38d52289dd [ 1216.997236] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.997369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.997440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.997661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.997753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.997846] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b612eb98-c678-44d5-aad6-8d38d52289dd already deleted. [ 1216.997927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b612eb98-c678-44d5-aad6-8d38d52289dd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.313544] env[65087]: INFO networking_nsxv3.common.synchronization [req-5e742268-5793-4447-b928-d639a59bbdd9 req-b70f479e-029b-4dbb-a4d3-80d7c58a07b3 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1219.314134] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1219.314442] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.314603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.314655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.314819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.314969] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.315090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.315152] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.315302] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.315385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.315477] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.687536] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.687536] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.687712] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.687899] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.688175] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.688335] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.688487] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.688722] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.688867] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.689262] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.689397] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.689507] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.689617] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.689733] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.689840] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.689970] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.710301] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.710472] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.710619] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.710817] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.711156] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-f277e94f-696e-4b39-8ead-2a720b2d81f6 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.711334] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-f277e94f-696e-4b39-8ead-2a720b2d81f6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.711458] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-f277e94f-696e-4b39-8ead-2a720b2d81f6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.711827] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-f277e94f-696e-4b39-8ead-2a720b2d81f6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.711976] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f277e94f-696e-4b39-8ead-2a720b2d81f6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.818052] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.214718] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.215019] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.215190] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.215515] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.215703] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.215885] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port f277e94f-696e-4b39-8ead-2a720b2d81f6 not found, creating... [ 1220.216190] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.216390] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.216561] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.216814] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.216983] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.217314] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.217506] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.217652] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.217892] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.218085] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.218270] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: f277e94f-696e-4b39-8ead-2a720b2d81f6 is going to be created. [ 1220.238562] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.238820] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.238876] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.239163] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.239399] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.239638] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-f277e94f-696e-4b39-8ead-2a720b2d81f6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.320786] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.823367] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.823570] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.823617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.823914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.824022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.824171] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1220.853139] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.853306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.853376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.853641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.853749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.866010] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1220.953857] env[65087]: INFO networking_nsxv3.common.synchronization [req-5e742268-5793-4447-b928-d639a59bbdd9 req-249f7f31-af28-4a72-a5f2-cb1ff48196e8 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1220.954453] env[65087]: INFO networking_nsxv3.common.synchronization [req-5e742268-5793-4447-b928-d639a59bbdd9 req-249f7f31-af28-4a72-a5f2-cb1ff48196e8 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1220.954579] env[65087]: INFO networking_nsxv3.common.synchronization [req-5e742268-5793-4447-b928-d639a59bbdd9 req-249f7f31-af28-4a72-a5f2-cb1ff48196e8 service nova] Enqueued Resource ID: f277e94f-696e-4b39-8ead-2a720b2d81f6 with Priority: HIGHEST for action port [ 1220.954827] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1220.954953] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1220.955060] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f277e94f-696e-4b39-8ead-2a720b2d81f6 with Priority: HIGHEST for action port [ 1220.955622] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.955771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.955810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.956013] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.956140] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.957017] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.957067] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.957250] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-f277e94f-696e-4b39-8ead-2a720b2d81f6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.957347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f277e94f-696e-4b39-8ead-2a720b2d81f6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.957406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f277e94f-696e-4b39-8ead-2a720b2d81f6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.957643] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f277e94f-696e-4b39-8ead-2a720b2d81f6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.957643] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f277e94f-696e-4b39-8ead-2a720b2d81f6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.460246] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.460523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.460602] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f277e94f-696e-4b39-8ead-2a720b2d81f6 with status ACTIVE [ 1221.460787] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.460901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.460970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.461199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.461291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.461457] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.461558] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.461619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.461765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.461833] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.462015] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.462112] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.462172] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.462310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.462381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.462465] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f277e94f-696e-4b39-8ead-2a720b2d81f6 is going to be updated. [ 1221.486054] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.486274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.486381] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.486608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.486772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.486938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f277e94f-696e-4b39-8ead-2a720b2d81f6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.559680] env[65087]: INFO networking_nsxv3.common.synchronization [req-0b9c043c-c0e1-4dcb-9fb5-9f16c5a1d78f req-b3ad343d-92f4-4777-8dda-2f4b8ee594a3 tempest-AttachVolumeTestJSON-120673121 tempest-AttachVolumeTestJSON-120673121-project-member] Enqueued Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_members [ 1221.560241] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_members [ 1221.560546] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.561500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.561500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.561500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.561500] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.561500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.561500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.561500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.561790] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.561790] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.900594] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.900784] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-634" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.900907] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-634" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.901272] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-634" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.901538] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.901702] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.901816] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.902038] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.902185] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.902421] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1221.902613] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1221.902674] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1221.902738] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1221.902848] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1221.902952] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1221.903097] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1221.926043] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1221.926215] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1221.926364] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1221.926550] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-634" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.926853] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-c6ba6719-be55-40a7-940d-abae150ef28d taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.927033] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-c6ba6719-be55-40a7-940d-abae150ef28d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.927156] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-c6ba6719-be55-40a7-940d-abae150ef28d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.927484] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-c6ba6719-be55-40a7-940d-abae150ef28d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.927624] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ba6719-be55-40a7-940d-abae150ef28d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.064324] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.064539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.064632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.065101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.065101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.065165] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.065259] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.065301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.065450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.065528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.065611] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 already deleted. [ 1222.065815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.430313] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.430609] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.430807] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.431192] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.431393] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.431588] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port c6ba6719-be55-40a7-940d-abae150ef28d not found, creating... [ 1222.431893] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.432107] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.432263] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.432509] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.432681] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.433031] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.433223] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.433373] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.434030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.434030] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.434030] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: c6ba6719-be55-40a7-940d-abae150ef28d is going to be created. [ 1222.454335] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.454590] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.454754] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.455079] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.455349] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.455608] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-c6ba6719-be55-40a7-940d-abae150ef28d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.875044] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1222.875345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.875539] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.875789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.876035] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.876180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.876268] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.876492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.876597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.876715] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.145983] env[65087]: INFO networking_nsxv3.common.synchronization [req-0b9c043c-c0e1-4dcb-9fb5-9f16c5a1d78f req-4de5c08e-36f4-475c-9203-73a9a2a76c78 service nova] Enqueued Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_rules [ 1223.146392] env[65087]: INFO networking_nsxv3.common.synchronization [req-0b9c043c-c0e1-4dcb-9fb5-9f16c5a1d78f req-4de5c08e-36f4-475c-9203-73a9a2a76c78 service nova] Enqueued Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_members [ 1223.146392] env[65087]: INFO networking_nsxv3.common.synchronization [req-0b9c043c-c0e1-4dcb-9fb5-9f16c5a1d78f req-4de5c08e-36f4-475c-9203-73a9a2a76c78 service nova] Enqueued Resource ID: c6ba6719-be55-40a7-940d-abae150ef28d with Priority: HIGHEST for action port [ 1223.146913] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_rules [ 1223.147067] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_members [ 1223.147167] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ba6719-be55-40a7-940d-abae150ef28d with Priority: HIGHEST for action port [ 1223.147439] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.147554] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.147623] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.147824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.147896] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.149153] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.149975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.150075] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.150202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.151105] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.151105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.151105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.151105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.151105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.151105] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.151670] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6ba6719-be55-40a7-940d-abae150ef28d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.151758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6ba6719-be55-40a7-940d-abae150ef28d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.151811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6ba6719-be55-40a7-940d-abae150ef28d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.151917] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6ba6719-be55-40a7-940d-abae150ef28d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.151994] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ba6719-be55-40a7-940d-abae150ef28d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.383801] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.653141] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.654119] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.654226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.654569] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6ba6719-be55-40a7-940d-abae150ef28d with status ACTIVE [ 1223.654755] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.654869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.654936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.655158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.655296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.655452] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.655496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.655573] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.655798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.655955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.656121] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.656495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.656495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.656495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.656495] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.656654] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6ba6719-be55-40a7-940d-abae150ef28d is going to be updated. [ 1223.685017] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.685217] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.685278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.685476] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.685619] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.685817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6ba6719-be55-40a7-940d-abae150ef28d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.885747] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.155144] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.388744] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.389092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.389244] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.389561] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.389786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.389916] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1224.418196] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.418413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.418509] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.418718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.418871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.428018] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1224.657820] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.657992] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.658077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.658291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.658383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.658978] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 is going to be created. [ 1224.683935] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.684105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.684176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.684382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.684546] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.695804] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 in Status: UNINITIALIZED for 2s [ 1226.441910] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1226.442289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.442330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.442553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.442749] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.442869] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.442934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.443104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.443189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.443278] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.443375] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.707648] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 in Status: SUCCESS [ 1226.707903] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.708086] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.708469] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.708795] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.709226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.709226] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.709363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.709400] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.709513] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.709815] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.945900] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.946130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.946187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.946452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.946645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.946760] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.946828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.947025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.947121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.947213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.947395] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.947571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.947571] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.947683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.947828] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.947919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.947979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.948132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.948208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.948322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.948401] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.212525] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.450892] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f55d553-c00f-4d69-9855-eb76f08469ec: rpc.has_security_group_logging(os_id): False [ 1227.471708] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.471878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.471936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.472154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.472250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.472553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.472675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.472675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.472819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.472909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.473080] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.473176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.473239] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.473377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.473452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.473639] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.473726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.473787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.473922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.473993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.474092] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1227.542260] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.542497] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.542617] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.542915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.543208] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.560440] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1227.715132] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b723fa5-5c7f-4620-826a-1db0feb0d4c9: rpc.has_security_group_logging(os_id): False [ 1227.732596] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.732797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.732797] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.733070] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.733183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.733511] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.733758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.733817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.734049] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.734145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.734248] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 is going to be created. [ 1227.792660] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.792881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.792881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.793051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.793236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.804773] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 in Status: IN_PROGRESS for 2s [ 1228.148778] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1228.148981] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1229.579426] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1229.579426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.817385] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 in Status: SUCCESS [ 1229.817620] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.838119] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d52f504-6acc-479d-b10f-c6202ea9b564 req-956b3c11-ad80-4626-872d-944d5f61d3b5 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1231.838654] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1231.839282] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.839282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.839282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.839553] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.839553] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.839651] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.839915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.839915] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.840033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.840070] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.342429] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.846339] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.349065] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.349289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.349384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.349686] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.349796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.349899] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1233.382684] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.382923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.382923] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.383146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.383298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.392935] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1234.811493] env[65087]: INFO networking_nsxv3.common.synchronization [req-6d54bb80-13a5-4954-a357-c143c5be9a82 req-615bac0d-581f-4b7f-a695-18a158d3db0a tempest-AttachVolumeNegativeTest-691098361 tempest-AttachVolumeNegativeTest-691098361-project-member] Enqueued Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_members [ 1234.812358] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGHEST for action security_group_members [ 1234.812358] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-ecf728b1-675c-48f4-b478-180e8f5f4a76 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.812504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.812588] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.812751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.813145] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.813145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.813145] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.813432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.813432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.813432] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.316284] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.316537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.316537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.317253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.317437] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.317611] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.317724] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.317863] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.317969] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.318058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.318146] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 is going to be updated. [ 1235.353973] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.354142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.354221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.354428] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.354585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.363914] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 in Status: IN_PROGRESS for 2s [ 1235.407655] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1235.407655] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.372356] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 in Status: SUCCESS [ 1237.372764] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 deletion is rescheduled due to dependency. [ 1237.372764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.402072] env[65087]: INFO networking_nsxv3.common.synchronization [req-7a515bdd-a61c-4ed7-b41e-47035c1cd3b1 req-f1a20d90-252c-4ec8-bdb5-7260ad3cda85 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1239.402780] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1239.403362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.403632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.403632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.404735] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.404735] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.404895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.404945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.405175] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.405240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.405344] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.907963] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.410661] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.912669] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.912939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.912939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.913157] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.913254] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.913355] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1240.948601] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.948895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.948895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.949063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.949201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.963163] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1242.974257] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1242.974673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.404364] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1244.404741] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1245.037370] env[65087]: INFO networking_nsxv3.common.synchronization [req-6d94e8d0-843c-4875-824a-cb5ae415caed req-559aecf6-985c-4013-aa38-d4a611344442 tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1245.037599] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1245.037931] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.038536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.038536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.038536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.038536] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.038765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.038765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.039224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.039224] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.039224] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.542059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.542595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.542595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.542595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.542776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.542870] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.542966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.543051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.543200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.543279] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.543366] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1245.574625] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.574815] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.574861] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.575063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.575210] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.585009] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1247.293759] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1247.294054] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:3 started [ 1247.597716] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1247.597961] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 deletion is rescheduled due to dependency. [ 1247.598036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.797950] env[65087]: INFO networking_nsxv3.common.synchronization [req-52b92e37-407f-4326-a174-9ef84a935349 req-cc1f9897-e117-430d-b19c-ba9cda2cb312 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1248.798640] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1248.799067] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.799197] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.799251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.799453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.799605] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.799703] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.799767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.799912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.799996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.800121] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.085946] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.086138] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.086289] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.086527] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.086837] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.087012] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.087135] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.087507] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.087580] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.087745] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1249.087859] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1249.087968] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1249.088088] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1249.088198] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1249.088301] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1249.088441] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1249.107682] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1249.107895] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1249.108069] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1249.108253] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.108585] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-3eaf5a86-5555-4e26-9802-4c4e73b9539a taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.108815] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-3eaf5a86-5555-4e26-9802-4c4e73b9539a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.108955] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-3eaf5a86-5555-4e26-9802-4c4e73b9539a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.109302] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-3eaf5a86-5555-4e26-9802-4c4e73b9539a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.109470] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eaf5a86-5555-4e26-9802-4c4e73b9539a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.302757] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.611937] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.612142] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.612271] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.612634] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.612774] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.612944] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 3eaf5a86-5555-4e26-9802-4c4e73b9539a not found, creating... [ 1249.613242] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.613397] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.613515] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.613739] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.613875] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.614167] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.614320] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.614436] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.614639] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.614774] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.614912] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 3eaf5a86-5555-4e26-9802-4c4e73b9539a is going to be created. [ 1249.634843] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.635086] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.635331] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.635598] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.635825] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.636065] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-3eaf5a86-5555-4e26-9802-4c4e73b9539a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.808051] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.310383] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.310751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.310836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.311084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.311180] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.311281] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1250.339364] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.339510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.339582] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.339798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.340486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.344247] env[65087]: INFO networking_nsxv3.common.synchronization [req-52b92e37-407f-4326-a174-9ef84a935349 req-e271c253-6d56-4578-a7b2-5c11ce7c9e50 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1250.344420] env[65087]: INFO networking_nsxv3.common.synchronization [req-52b92e37-407f-4326-a174-9ef84a935349 req-e271c253-6d56-4578-a7b2-5c11ce7c9e50 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1250.344559] env[65087]: INFO networking_nsxv3.common.synchronization [req-52b92e37-407f-4326-a174-9ef84a935349 req-e271c253-6d56-4578-a7b2-5c11ce7c9e50 service nova] Enqueued Resource ID: 3eaf5a86-5555-4e26-9802-4c4e73b9539a with Priority: HIGHEST for action port [ 1250.344795] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1250.344927] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1250.345036] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eaf5a86-5555-4e26-9802-4c4e73b9539a with Priority: HIGHEST for action port [ 1250.345634] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.345751] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.345822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.346012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.346094] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.346924] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.347032] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.347185] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eaf5a86-5555-4e26-9802-4c4e73b9539a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.347949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eaf5a86-5555-4e26-9802-4c4e73b9539a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.347949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eaf5a86-5555-4e26-9802-4c4e73b9539a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.347949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eaf5a86-5555-4e26-9802-4c4e73b9539a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.348099] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eaf5a86-5555-4e26-9802-4c4e73b9539a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.349825] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1250.849827] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.850216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.851334] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3eaf5a86-5555-4e26-9802-4c4e73b9539a with status ACTIVE [ 1250.851523] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.851646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.851698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.851922] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.852023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.852196] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.852291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.852349] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.852499] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.852597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.852785] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.852882] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.852945] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.853116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.853192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.853276] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3eaf5a86-5555-4e26-9802-4c4e73b9539a is going to be updated. [ 1250.876858] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.877053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.877133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.877350] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.877506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.877706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eaf5a86-5555-4e26-9802-4c4e73b9539a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.358681] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1252.359090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.359136] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.359324] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.359511] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.359625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.359691] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.359858] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.359957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.360065] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.863422] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.161266] env[65087]: INFO networking_nsxv3.common.synchronization [req-9db30e84-efbb-406f-9591-7880e679cd47 req-f3c36cea-068f-4330-ba87-5d881f8c7591 tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1253.161885] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1253.162282] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.162429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.162501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.162699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.162875] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.162971] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.163057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.163214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.163316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.163410] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.365379] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.492641] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.492874] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.493150] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.493435] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.493690] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.493845] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.493961] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.494231] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.494396] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.494602] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1253.494713] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1253.494819] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1253.494927] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1253.495063] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1253.495172] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1253.495302] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1253.514990] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1253.515193] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1253.515333] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1253.515508] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-479" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.515822] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-382f988d-33f5-4a28-b580-e00f73ea2a70 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.516051] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-382f988d-33f5-4a28-b580-e00f73ea2a70" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.516187] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-382f988d-33f5-4a28-b580-e00f73ea2a70" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.516511] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-382f988d-33f5-4a28-b580-e00f73ea2a70" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.516652] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('382f988d-33f5-4a28-b580-e00f73ea2a70',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.665257] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.665416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.665458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.665676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.665812] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.666041] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.666151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.666213] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.666374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.666453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.666538] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1253.690523] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.690706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.690706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.690891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.691051] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.699519] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1253.867692] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.867948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.867948] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.868304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.868304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.868393] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1253.899555] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.899733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.899733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.899958] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.900124] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.909450] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1254.019325] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.019735] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.019735] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.020102] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.020263] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.020421] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 382f988d-33f5-4a28-b580-e00f73ea2a70 not found, creating... [ 1254.020681] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.020841] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.020957] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.021199] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.021336] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.021610] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.021763] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.021877] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.022279] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.022475] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.022670] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 382f988d-33f5-4a28-b580-e00f73ea2a70 is going to be created. [ 1254.042578] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.042910] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.043200] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.043522] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.043785] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.044064] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-382f988d-33f5-4a28-b580-e00f73ea2a70" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.737026] env[65087]: INFO networking_nsxv3.common.synchronization [req-9db30e84-efbb-406f-9591-7880e679cd47 req-90fc695a-909f-4e60-8a69-fa9b1d982943 service nova] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 1254.737283] env[65087]: INFO networking_nsxv3.common.synchronization [req-9db30e84-efbb-406f-9591-7880e679cd47 req-90fc695a-909f-4e60-8a69-fa9b1d982943 service nova] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1254.737427] env[65087]: INFO networking_nsxv3.common.synchronization [req-9db30e84-efbb-406f-9591-7880e679cd47 req-90fc695a-909f-4e60-8a69-fa9b1d982943 service nova] Enqueued Resource ID: 382f988d-33f5-4a28-b580-e00f73ea2a70 with Priority: HIGHEST for action port [ 1254.738013] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_rules [ 1254.738267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1254.738339] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 382f988d-33f5-4a28-b580-e00f73ea2a70 with Priority: HIGHEST for action port [ 1254.738645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.738782] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.738887] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.739121] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.739205] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.740557] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.740664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.740874] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-382f988d-33f5-4a28-b580-e00f73ea2a70 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.740979] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-382f988d-33f5-4a28-b580-e00f73ea2a70" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.741085] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-382f988d-33f5-4a28-b580-e00f73ea2a70" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.741336] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-382f988d-33f5-4a28-b580-e00f73ea2a70" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.741336] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('382f988d-33f5-4a28-b580-e00f73ea2a70',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.242756] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.242953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.245335] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 382f988d-33f5-4a28-b580-e00f73ea2a70 with status ACTIVE [ 1255.245616] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.245719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.245773] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.246096] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.246235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.246507] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.246648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.246737] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.246980] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.247149] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.247391] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.247527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.247632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.247841] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.247949] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.248100] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 382f988d-33f5-4a28-b580-e00f73ea2a70 is going to be updated. [ 1255.270304] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.270450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.270534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.270743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.270885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.271071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-382f988d-33f5-4a28-b580-e00f73ea2a70" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.709129] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1255.709294] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 deletion is rescheduled due to dependency. [ 1255.709395] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.709567] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.709766] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.709979] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.710126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.710193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.710347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.710427] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.710522] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.919675] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1255.920090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.920090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.920330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.920514] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.920632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.920701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.920854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.920938] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.921038] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.921169] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.213502] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.423533] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.423752] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.423808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.424048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.424239] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.424380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.424441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.424615] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.424706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.424807] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.424968] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.425090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.425163] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.425323] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.425475] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.425581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.425646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.425803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.425883] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.425991] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.426099] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.716162] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.928426] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f55d553-c00f-4d69-9855-eb76f08469ec: rpc.has_security_group_logging(os_id): False [ 1256.946533] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.946729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.946781] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.947025] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.947125] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.947356] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.947461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.947531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.947717] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.947810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.947981] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.948093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.948154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.948295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.948370] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.948558] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.948654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.948732] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.948912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.948984] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.949089] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1257.013544] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.013765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.013842] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.014058] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.014209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.032405] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1257.218958] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.219178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.219246] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.219473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.219566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.219710] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1257.257859] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.258100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.258158] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.258432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.258645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.268493] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1259.053651] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1259.054093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.277717] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1259.277934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.278118] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.278356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.278546] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.278880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.278880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.278880] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.279066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.279066] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.279152] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.739633] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.739741] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1259.782383] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.285325] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3411048-5318-4245-bd13-ad8c65f4de91: rpc.has_security_group_logging(os_id): False [ 1260.303621] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.303827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.303900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.304161] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.304297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.304573] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.305162] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.305282] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.305500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.305596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.305717] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1260.368108] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.368328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.368411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.368648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.368854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.382597] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1261.306214] env[65087]: INFO networking_nsxv3.common.synchronization [req-ed79915b-4665-4602-8093-cdafd622c1c0 req-ae454756-e0ad-4f15-82d9-d28de914010f tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1261.306943] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1261.307509] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.307671] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.307742] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.307955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.308261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.308419] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.308491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.308678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.308785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.308904] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.901081] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.315805] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.396669] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1262.396964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.818362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.818583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.818583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.819054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.819171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.819319] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1262.846476] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.846681] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.846755] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.847091] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.847283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.859458] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1264.870967] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1264.871367] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.308247] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1266.308635] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.518620] env[65087]: INFO networking_nsxv3.common.synchronization [req-18f3d8aa-db3b-47b5-a995-972e842f69d6 req-d88b09ec-6b2a-4df1-8ef2-37af627dedf6 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1270.518620] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1270.518890] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.518890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.518890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.519143] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.519303] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.519409] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.519450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.519632] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.519738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.519833] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.834850] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.835063] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.835184] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.835448] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.835701] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.835883] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.836012] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.836228] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.836370] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.836570] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.836670] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.836837] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.837020] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.837149] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1270.837259] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.837523] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.858270] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.858454] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1270.858561] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.858737] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-151" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.859133] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.859333] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.859444] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.859780] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.859921] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f28a71f-6ab6-4fc7-b05d-26f9a573a08e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.021888] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.362021] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.362362] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.362362] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.362656] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.362813] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.362966] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 5f28a71f-6ab6-4fc7-b05d-26f9a573a08e not found, creating... [ 1271.363246] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.363402] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.363517] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.363738] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.363878] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.364217] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.364379] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.364497] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.364701] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.364830] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.364967] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 5f28a71f-6ab6-4fc7-b05d-26f9a573a08e is going to be created. [ 1271.385311] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.385589] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.385589] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.385852] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.386087] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.386315] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.523881] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.026864] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.027480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.027480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.027480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.027480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.027744] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1272.056170] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.056357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.056357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.057475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.057475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.066657] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1272.097088] env[65087]: INFO networking_nsxv3.common.synchronization [req-18f3d8aa-db3b-47b5-a995-972e842f69d6 req-836da7a4-f372-4f92-9a25-0a2afd492228 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1272.097342] env[65087]: INFO networking_nsxv3.common.synchronization [req-18f3d8aa-db3b-47b5-a995-972e842f69d6 req-836da7a4-f372-4f92-9a25-0a2afd492228 service nova] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1272.097489] env[65087]: INFO networking_nsxv3.common.synchronization [req-18f3d8aa-db3b-47b5-a995-972e842f69d6 req-836da7a4-f372-4f92-9a25-0a2afd492228 service nova] Enqueued Resource ID: 5f28a71f-6ab6-4fc7-b05d-26f9a573a08e with Priority: HIGHEST for action port [ 1272.098180] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_rules [ 1272.098325] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1272.098463] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f28a71f-6ab6-4fc7-b05d-26f9a573a08e with Priority: HIGHEST for action port [ 1272.098829] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.098993] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.099255] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.099521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.099664] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.100881] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.101033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.101262] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.101401] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.101486] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.102111] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.102111] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f28a71f-6ab6-4fc7-b05d-26f9a573a08e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.604226] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.604839] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.604839] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f28a71f-6ab6-4fc7-b05d-26f9a573a08e with status ACTIVE [ 1272.604960] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.605071] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.605192] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.605520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.605678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.606036] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.606271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.606467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.606696] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.606855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.607229] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.607376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.607507] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.607640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.607765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.607832] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f28a71f-6ab6-4fc7-b05d-26f9a573a08e is going to be updated. [ 1272.631222] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.631485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.631485] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.631716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.631875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.632101] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f28a71f-6ab6-4fc7-b05d-26f9a573a08e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.076493] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1274.076947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.076947] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.077200] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.077388] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.077511] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.077568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.077758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.077874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.077989] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.580970] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.083692] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.585645] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.586103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.586103] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.586356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.586458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.586560] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1275.615064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.615222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.615280] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.615492] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.615645] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.625704] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1277.099492] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.099943] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1277.637752] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1277.638110] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.638298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.638528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.638717] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.638838] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.638906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.639135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.639245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.639341] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.639435] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.142623] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.143060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.143060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.143060] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.143245] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.143363] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.143538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.143664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.143778] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.143906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.144078] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.144177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.144240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.144477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.144542] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.144625] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.144684] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.144820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.144895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.144975] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.145078] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.647325] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f55d553-c00f-4d69-9855-eb76f08469ec: rpc.has_security_group_logging(os_id): False [ 1278.665059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.665246] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.665298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.665491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.665587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.665807] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.665909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.665974] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.666148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.666229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.666409] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.666505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.666568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.666714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.666789] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.666975] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.667105] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.667201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.667408] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.667534] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.667673] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1278.728057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.728287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.728287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.728510] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.728627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.745071] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1280.765916] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1280.766263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.100842] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.101267] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1283.900442] env[65087]: INFO networking_nsxv3.common.synchronization [req-9cd530a7-faeb-49bd-8565-c8aeccda2fd3 req-10560e87-bb3a-4646-97ce-bd824aa285a2 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1283.900442] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1283.900442] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.901465] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.901669] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.901960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.902390] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.902639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.902817] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.903131] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.903326] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.903519] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.405945] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.907520] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.238465] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.238654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.238775] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.239090] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.239315] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.410271] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.410479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.410479] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.410690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.410811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.410915] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1285.441366] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.441551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.441603] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.441813] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.441962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.452420] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1285.741767] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.243892] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.746672] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1286.746853] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1287.470868] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1287.472055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.779095] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.779347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.779472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.779711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.795313] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1287.796311] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.797355] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1287.840039] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.840229] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.840318] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.840535] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.856287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.857220] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1287.857349] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1287.857499] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1287.897194] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.897443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.897443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.898518] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.899744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.899949] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1287.987787] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.987990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.987990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.988296] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.988536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.988836] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1288.067652] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.067898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.067931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.068201] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.068530] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.068890] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1288.069025] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'dbf33eac-b2a3-4597-bef7-45961c5c9915', '39d49db7-880a-475c-959f-8bf596c72350', '5bcf33c2-ef1a-4c31-9cc7-939110cde89e', '1f55d553-c00f-4d69-9855-eb76f08469ec', '664c49c8-8d39-49fa-b67a-7036d944867d', '0cdd684c-5a6e-4834-b6e5-a34e0caee842', 'f3411048-5318-4245-bd13-ad8c65f4de91', 'b1379de6-944a-41ee-b7a5-1b4425bc546e', '336c99cf-6401-42f0-a311-bcd662eef8ca', 'd11ae3e7-68e0-48ab-9cf6-d1803117fc1f', 'b7d83079-ca61-42cb-b6f4-fd429feaca4e', '50e018c5-8d62-4c55-9680-f69bf86acab6', 'e4620817-a8af-47ab-8dc5-45c9281feca7', '6b5dadcb-8f3a-482e-b14c-24a6ef163d88', '9b723fa5-5c7f-4620-826a-1db0feb0d4c9', 'ecf728b1-675c-48f4-b478-180e8f5f4a76', 'ae0af2af-9718-4a7b-876d-92e1124cdbd2', '0dd4d842-afe8-4003-a8ee-07600ff1edfd', '02feb9e5-0f08-496b-8186-408b46050c5d', '4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd', 'e56f2582-99a0-4048-840f-b0950b64562f', 'd58a5975-db0d-4e76-84b4-0eaa1b1c8688', '49706196-d349-4818-ae7e-d6615560719a', '5e5af08c-4029-463c-937e-2ea7bf68d7d1', '5d415299-ca3d-4305-942b-69b3b58ccb49', '851d68f8-1229-406c-ac33-c91b60c34ee0', 'c1371be0-e403-4fc8-b7ba-48edcbdada5e', '7083382f-6e66-45d0-9fc4-efa15b381900', '078ba4a4-0e86-4b25-838d-1fc110729dbd', 'c43c7a55-d9c9-4a13-b1c9-0aea6b2ffbdc', 'ac3c0a5a-197c-4c4c-a82b-9342302fe922', '2fb66ad5-69f7-466f-94b1-24f53af1b70c', '13c5346a-4114-4ee9-bda4-7f968a612f58', '4986f406-ffa8-458b-a142-64bc589ad53b', 'de120ad0-cbd8-47c5-85f0-73d798da60f8', 'e38df862-3877-4fbb-b2b8-8702550f272a', 'aa843f83-ade7-475f-9e86-d1f12b4e1f38', '082fc1a8-0a58-4162-926b-fe01957908a7', 'a5fd4ec2-d6c3-4894-bd80-751b7e6176d6', '0521b23b-9dcc-40b0-a1c4-32590b372bcd', 'a6dd9b03-d553-4b7a-b9f5-f9e3b715daba', '43a553ce-6692-41a3-ab44-fe5b38b80d7f', '0756d72c-9df8-4861-9190-090f401edeb6', 'd8285264-bd0f-4381-9dd8-8b3192b9b544'} {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1288.069121] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1288.090056] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.090266] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.090371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.090587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.090672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.090785] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1288.090860] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1288.090933] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1288.168603] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.168816] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.168921] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.169692] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.170538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.170858] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1288.170968] env[65087]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65087) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1288.171098] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1288.171202] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1288.171320] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1288.171421] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGH for action security_group_rules [ 1288.171536] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGH for action security_group_rules [ 1288.171644] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGH for action security_group_rules [ 1288.171741] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGH for action security_group_rules [ 1288.171835] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGH for action security_group_rules [ 1288.171929] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGH for action security_group_rules [ 1288.172032] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGH for action security_group_rules [ 1288.172127] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGH for action security_group_rules [ 1288.172220] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGH for action security_group_rules [ 1288.172313] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGH for action security_group_rules [ 1288.172404] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGH for action security_group_rules [ 1288.172496] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGH for action security_group_rules [ 1288.172607] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGH for action security_group_rules [ 1288.172671] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGH for action security_group_rules [ 1288.172763] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGH for action security_group_rules [ 1288.172860] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGH for action security_group_rules [ 1288.172956] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGH for action security_group_rules [ 1288.173066] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGH for action security_group_rules [ 1288.173165] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGH for action security_group_rules [ 1288.173263] env[65087]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGH for action security_group_rules [ 1288.173390] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.901372] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.901779] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1288.901779] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 with Priority: HIGH for action security_group_rules [ 1288.902027] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e with Priority: HIGH for action security_group_rules [ 1288.902218] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGH for action security_group_rules [ 1288.902403] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGH for action security_group_rules [ 1288.902548] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd with Priority: HIGH for action security_group_rules [ 1288.902653] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02feb9e5-0f08-496b-8186-408b46050c5d with Priority: HIGH for action security_group_rules [ 1288.902751] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd with Priority: HIGH for action security_group_rules [ 1288.902917] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 with Priority: HIGH for action security_group_rules [ 1288.903046] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 with Priority: HIGH for action security_group_rules [ 1288.903176] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 with Priority: HIGH for action security_group_rules [ 1288.903282] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4620817-a8af-47ab-8dc5-45c9281feca7 with Priority: HIGH for action security_group_rules [ 1288.903378] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 with Priority: HIGH for action security_group_rules [ 1288.903475] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e with Priority: HIGH for action security_group_rules [ 1288.903622] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f with Priority: HIGH for action security_group_rules [ 1288.903793] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336c99cf-6401-42f0-a311-bcd662eef8ca with Priority: HIGH for action security_group_rules [ 1288.903894] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 with Priority: HIGH for action security_group_rules [ 1288.903982] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1379de6-944a-41ee-b7a5-1b4425bc546e with Priority: HIGH for action security_group_rules [ 1288.904088] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664c49c8-8d39-49fa-b67a-7036d944867d with Priority: HIGH for action security_group_rules [ 1288.904178] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d49db7-880a-475c-959f-8bf596c72350 with Priority: HIGH for action security_group_rules [ 1288.904266] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGH for action security_group_rules [ 1288.904608] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbf33eac-b2a3-4597-bef7-45961c5c9915 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.904765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.904825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.905132] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.905286] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbf33eac-b2a3-4597-bef7-45961c5c9915',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.906382] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.906538] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.906608] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.906787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.906886] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5bcf33c2-ef1a-4c31-9cc7-939110cde89e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.907834] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.907962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.908054] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.908361] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.908361] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.909291] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.910228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.910228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.910228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.910228] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.910486] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.910611] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.910694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.910934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.910934] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.911711] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02feb9e5-0f08-496b-8186-408b46050c5d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.911786] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.911835] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.911981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.912067] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02feb9e5-0f08-496b-8186-408b46050c5d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.912910] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.912910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.912910] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.913080] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.913136] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dd4d842-afe8-4003-a8ee-07600ff1edfd',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.913898] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.913898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.914055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.914097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.914445] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae0af2af-9718-4a7b-876d-92e1124cdbd2',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.916580] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.916695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.916738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.917253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.917253] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b5dadcb-8f3a-482e-b14c-24a6ef163d88',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.917662] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ecf728b1-675c-48f4-b478-180e8f5f4a76 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.917772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.917849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.918214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.918214] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ecf728b1-675c-48f4-b478-180e8f5f4a76',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.919641] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4620817-a8af-47ab-8dc5-45c9281feca7 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.919641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.919641] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.919818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.919818] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4620817-a8af-47ab-8dc5-45c9281feca7',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.920686] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50e018c5-8d62-4c55-9680-f69bf86acab6 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.920809] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.920875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.921057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.921147] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50e018c5-8d62-4c55-9680-f69bf86acab6',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.921896] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.922037] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.922383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.922383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.922383] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7d83079-ca61-42cb-b6f4-fd429feaca4e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.923059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.923183] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.923242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.923399] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.923462] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d11ae3e7-68e0-48ab-9cf6-d1803117fc1f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.924124] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-336c99cf-6401-42f0-a311-bcd662eef8ca taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.924230] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.924297] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.924443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.924514] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('336c99cf-6401-42f0-a311-bcd662eef8ca',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.925278] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.925383] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.925448] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.925597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.925670] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0cdd684c-5a6e-4834-b6e5-a34e0caee842',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.926451] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1379de6-944a-41ee-b7a5-1b4425bc546e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.926451] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.926585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.926627] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.926989] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1379de6-944a-41ee-b7a5-1b4425bc546e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.927360] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-664c49c8-8d39-49fa-b67a-7036d944867d taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.927500] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.927547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.927706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.927752] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('664c49c8-8d39-49fa-b67a-7036d944867d',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.928488] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39d49db7-880a-475c-959f-8bf596c72350 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.928822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.928822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.928822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.928959] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39d49db7-880a-475c-959f-8bf596c72350',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.929524] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.929622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.929699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.929825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.929897] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.438798] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.438960] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.439040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.439303] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.439476] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.439604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.439695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.439914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.440062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.440203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.440333] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.446292] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.446544] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.446674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.446953] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.447217] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.447372] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.447491] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.447729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.447916] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.448040] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.448197] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.456513] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.456763] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.456885] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.457260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.457444] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.457613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.457719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.457940] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.458098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.458244] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.458394] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.470585] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.475060] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.475234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.475330] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.475647] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.475844] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.475955] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.476053] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.476245] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.476358] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.476424] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.476584] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.476718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.476779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.476952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.477110] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.477235] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.477362] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.477460] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.477537] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.477628] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.477730] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.506396] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.506613] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.506661] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.506927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.514776] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.514956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.519946] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.520123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.521157] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.521309] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.522186] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.522298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.523160] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.523295] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.524879] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.525034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.525859] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.525987] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.526749] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.526846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.527548] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.527668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.528846] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.528970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.529977] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.530458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.530583] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.531240] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.531668] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.531800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.537682] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.537891] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.537998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.539032] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.539476] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.539572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.540268] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.540696] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.540802] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.541457] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1289.541897] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.542027] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39d49db7-880a-475c-959f-8bf596c72350 is going to be deleted. [ 1289.543508] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.543604] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.543678] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.543872] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.561739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.561908] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ecf728b1-675c-48f4-b478-180e8f5f4a76 is going to be deleted. [ 1289.562827] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.563072] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.584204] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.584404] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7d83079-ca61-42cb-b6f4-fd429feaca4e is going to be deleted. [ 1289.585249] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.585459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.599382] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.599649] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.605042] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.605163] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0cdd684c-5a6e-4834-b6e5-a34e0caee842 is going to be deleted. [ 1289.606028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.606244] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.621117] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.621327] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.628033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.628167] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4620817-a8af-47ab-8dc5-45c9281feca7 is going to be deleted. [ 1289.629057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.629298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.645083] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.645260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.646925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.647064] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b5dadcb-8f3a-482e-b14c-24a6ef163d88 is going to be deleted. [ 1289.647957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.648188] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.670532] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.670729] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.691695] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.691826] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d11ae3e7-68e0-48ab-9cf6-d1803117fc1f is going to be deleted. [ 1289.692771] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.692983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.734284] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.734504] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.736791] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.736925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.766542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.766683] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dd4d842-afe8-4003-a8ee-07600ff1edfd is going to be deleted. [ 1289.767725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.768012] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.830764] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.830940] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 336c99cf-6401-42f0-a311-bcd662eef8ca is going to be deleted. [ 1289.831843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.832083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.913328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.913712] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1379de6-944a-41ee-b7a5-1b4425bc546e is going to be deleted. [ 1289.915281] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.915547] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.922860] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.923048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.931385] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.931565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.962256] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.962421] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae0af2af-9718-4a7b-876d-92e1124cdbd2 is going to be deleted. [ 1289.963306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.963522] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.964374] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.981797] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b723fa5-5c7f-4620-826a-1db0feb0d4c9: rpc.has_security_group_logging(os_id): False [ 1289.986541] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f55d553-c00f-4d69-9855-eb76f08469ec: rpc.has_security_group_logging(os_id): False [ 1290.002402] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.002607] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.003249] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.003356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.006394] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.006571] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50e018c5-8d62-4c55-9680-f69bf86acab6 is going to be deleted. [ 1290.007997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.008234] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.018643] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.018855] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.024942] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.025148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.058242] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.058424] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02feb9e5-0f08-496b-8186-408b46050c5d is going to be deleted. [ 1290.059368] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.059586] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.107312] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.107454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.119714] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.119919] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd is going to be deleted. [ 1290.121441] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.121772] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.165045] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.165286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.200957] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.201186] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbf33eac-b2a3-4597-bef7-45961c5c9915 is going to be deleted. [ 1290.202260] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.202532] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.216800] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.216943] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.223146] env[65087]: INFO networking_nsxv3.common.synchronization [req-7d206aad-923d-4680-baa6-217eb86a1dbf req-d82e0344-0f66-4df3-9065-733de346e1c6 tempest-ServersTestJSON-236234912 tempest-ServersTestJSON-236234912-project-member] Enqueued Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1290.223697] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f55d553-c00f-4d69-9855-eb76f08469ec with Priority: HIGHEST for action security_group_members [ 1290.224012] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f55d553-c00f-4d69-9855-eb76f08469ec taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.224316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.224316] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.224440] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.224605] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.224672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.224722] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.224889] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.224936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.225030] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f55d553-c00f-4d69-9855-eb76f08469ec',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.230478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.230646] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5bcf33c2-ef1a-4c31-9cc7-939110cde89e is going to be deleted. [ 1290.231878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.232113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.277357] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.277357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.279965] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.279965] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 664c49c8-8d39-49fa-b67a-7036d944867d is going to be deleted. [ 1290.280849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.281113] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.281283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.281331] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39d49db7-880a-475c-959f-8bf596c72350" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.281480] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.281683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.281788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.281946] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ecf728b1-675c-48f4-b478-180e8f5f4a76" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.282505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.282699] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.282792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.282931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7d83079-ca61-42cb-b6f4-fd429feaca4e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.283079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.283227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.283344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.283463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0cdd684c-5a6e-4834-b6e5-a34e0caee842" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.283634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.283818] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.283878] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.284029] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b5dadcb-8f3a-482e-b14c-24a6ef163d88" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.284199] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.284371] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.284467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.284599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4620817-a8af-47ab-8dc5-45c9281feca7" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.284734] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.284892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.284973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.285116] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d11ae3e7-68e0-48ab-9cf6-d1803117fc1f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.285287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.285464] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.285676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.285798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dd4d842-afe8-4003-a8ee-07600ff1edfd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.285927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.286079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.286178] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.286265] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-336c99cf-6401-42f0-a311-bcd662eef8ca" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.286387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.286523] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.286595] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.286701] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1379de6-944a-41ee-b7a5-1b4425bc546e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.286820] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.286951] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.352869] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.353098] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.358104] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.358458] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.358579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.358637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.358864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.358962] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.359094] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 is going to be updated. [ 1290.360459] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.360715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.362578] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.362690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.411891] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.412207] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.412347] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.412432] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.412637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.412725] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.412918] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.413036] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.413203] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.413565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.413565] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.413650] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.413704] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.413753] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.413952] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.414062] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.414161] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1290.415305] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.415660] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.415904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.416369] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50e018c5-8d62-4c55-9680-f69bf86acab6" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.416700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.417133] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.417385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.417658] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02feb9e5-0f08-496b-8186-408b46050c5d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.417934] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.418189] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.418356] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.418630] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b9dcb60-7cd2-49f3-891f-f9fd5aa31acd" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.418811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.418990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.419123] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.419382] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbf33eac-b2a3-4597-bef7-45961c5c9915" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.420257] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.420516] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.420636] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.420792] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae0af2af-9718-4a7b-876d-92e1124cdbd2" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.420930] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.421148] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.421250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.421403] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5bcf33c2-ef1a-4c31-9cc7-939110cde89e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.451396] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.451664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.451664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.451787] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.451875] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.452022] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-664c49c8-8d39-49fa-b67a-7036d944867d" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.466598] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3411048-5318-4245-bd13-ad8c65f4de91: rpc.has_security_group_logging(os_id): False [ 1290.516020] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.516247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.516247] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.516406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.516563] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.518850] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.519033] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.519081] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.519402] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.579920] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 in Status: IN_PROGRESS for 2s [ 1290.580949] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.581144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.588663] env[65087]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1290.589228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.589548] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.589663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.589718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.589914] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.589997] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.590097] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1290.591253] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.591429] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.591580] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.664698] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1290.714930] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.715221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.715221] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.715315] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.715461] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.727261] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.727463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.727463] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.727683] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.727776] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.728456] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.728456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.728456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.728456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.728456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.728456] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec is going to be updated. [ 1290.742168] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1290.762302] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.762550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.762550] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.762706] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.762852] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.773212] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: IN_PROGRESS for 2s [ 1292.594076] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 in Status: SUCCESS [ 1292.594076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.683222] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1292.683493] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.758314] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1292.758581] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.781905] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f55d553-c00f-4d69-9855-eb76f08469ec in Status: SUCCESS [ 1292.782196] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f55d553-c00f-4d69-9855-eb76f08469ec deletion is rescheduled due to dependency. [ 1292.782308] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f55d553-c00f-4d69-9855-eb76f08469ec" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.225017] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.225375] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1296.508893] env[65087]: INFO networking_nsxv3.common.synchronization [req-d6581cc6-eb31-47c4-923c-7f15cf8d7791 req-882b7c4f-d869-49fc-a1e0-bc1a2b9226a0 tempest-ServerActionsTestOtherB-1688726736 tempest-ServerActionsTestOtherB-1688726736-project-member] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1296.509584] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1296.509915] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.510063] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.510135] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.510453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.510705] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.510828] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.510895] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.511076] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.511168] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.511266] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.013386] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.013648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.013648] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.013810] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.036805] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.037090] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.037236] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.037298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.037503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.037589] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.037678] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1297.068193] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.068430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.068430] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.068599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.068744] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.079169] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1299.090743] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1299.091186] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a deletion is rescheduled due to dependency. [ 1299.091186] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.511137] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1301.511505] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.330444] env[65087]: INFO networking_nsxv3.common.synchronization [req-ac51df16-b887-4b13-9310-74b2fe5f0dd7 req-4f4a43e3-6bd7-4bf6-b789-c165a9e72b6a tempest-ServerActionsTestOtherB-1688726736 tempest-ServerActionsTestOtherB-1688726736-project-member] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1305.330738] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1305.331199] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.331345] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.331418] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.331622] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.331797] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.331906] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.331972] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.332170] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.332222] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.332896] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.655822] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.656090] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.656200] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.656526] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.656792] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.656952] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.657093] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.657328] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.657499] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.657722] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1305.657871] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1305.657987] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1305.658107] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1305.658220] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1305.658325] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1305.658457] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1305.686557] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1305.686735] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1305.686863] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1305.687049] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.687829] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.688014] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.688090] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.688432] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.688577] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f19fdd1-5616-44f3-81ad-05f4fa90aa0e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.834454] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.834700] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.834801] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.835127] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.835271] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.835564] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.835726] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.835836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.836088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.836212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.836343] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1305.863768] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.863963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.863963] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.864169] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.864310] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.872972] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1306.191172] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.191443] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.191549] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.191840] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.191985] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.192153] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e not found, creating... [ 1306.192413] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.192569] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.192684] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.192955] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.193037] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.193311] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.193463] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.193590] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.193782] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.193911] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.194058] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e is going to be created. [ 1306.213560] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.213773] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.213877] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.214150] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.214375] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.214591] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.916538] env[65087]: INFO networking_nsxv3.common.synchronization [req-ac51df16-b887-4b13-9310-74b2fe5f0dd7 req-1bdf3126-f94e-450d-b2cf-d8a66b89a685 service nova] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1306.916820] env[65087]: INFO networking_nsxv3.common.synchronization [req-ac51df16-b887-4b13-9310-74b2fe5f0dd7 req-1bdf3126-f94e-450d-b2cf-d8a66b89a685 service nova] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1306.916862] env[65087]: INFO networking_nsxv3.common.synchronization [req-ac51df16-b887-4b13-9310-74b2fe5f0dd7 req-1bdf3126-f94e-450d-b2cf-d8a66b89a685 service nova] Enqueued Resource ID: 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e with Priority: HIGHEST for action port [ 1306.917387] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1306.917521] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1306.917620] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e with Priority: HIGHEST for action port [ 1306.917890] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.918156] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.918202] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.918475] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.918511] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.919346] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.919487] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.919658] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.919799] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.919928] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.919981] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.920262] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f19fdd1-5616-44f3-81ad-05f4fa90aa0e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.422035] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.422306] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.422414] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e with status ACTIVE [ 1307.422648] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.422756] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.422822] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.423093] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.423191] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.423361] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.423458] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.423520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.423693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.423804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.423985] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.424153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.424193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.424343] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.424436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.424547] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e is going to be updated. [ 1307.447013] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.447274] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.447332] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.447566] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.447718] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.447931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.883820] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1307.884011] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a deletion is rescheduled due to dependency. [ 1307.884137] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.884298] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.884551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.884758] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.884864] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.884904] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.885055] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.885139] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.885234] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.387885] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.892300] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.396406] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.396406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.396406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.396406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.396406] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.396406] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1309.426248] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.426392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.426471] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.426743] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.426836] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.435271] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1311.447245] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1311.447698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.447698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.447854] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.448064] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.448181] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.448251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.448413] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.448496] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.448585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.448687] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.918439] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1311.918602] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1311.951061] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.453740] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49706196-d349-4818-ae7e-d6615560719a: rpc.has_security_group_logging(os_id): False [ 1312.472232] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.472450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.472450] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.472639] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.472733] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.472972] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.473089] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.473150] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.473335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.473404] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.473524] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1312.536421] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.536650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.536650] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.536849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.537018] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.551315] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1314.566012] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1314.566411] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.919276] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1316.919631] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1318.840611] env[65087]: INFO networking_nsxv3.common.synchronization [req-b898f01c-601f-4ae0-98ec-59ea96d66f73 req-83796ad3-d960-4cb4-acb1-834792e88f83 tempest-ServerActionsTestJSON-1861916402 tempest-ServerActionsTestJSON-1861916402-project-member] Enqueued Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1318.841232] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3411048-5318-4245-bd13-ad8c65f4de91 with Priority: HIGHEST for action security_group_members [ 1318.841835] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3411048-5318-4245-bd13-ad8c65f4de91 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.842014] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.842100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.842344] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.842524] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.842654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.842727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.842920] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.843126] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.843207] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3411048-5318-4245-bd13-ad8c65f4de91',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.346052] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.346052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.346052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.346052] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.346391] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.346391] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.346473] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.346503] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.346640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.346707] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.346796] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 is going to be updated. [ 1319.373626] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.373849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.373849] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.374067] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.374212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.382226] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: IN_PROGRESS for 2s [ 1321.394127] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3411048-5318-4245-bd13-ad8c65f4de91 in Status: SUCCESS [ 1321.394568] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3411048-5318-4245-bd13-ad8c65f4de91 deletion is rescheduled due to dependency. [ 1321.394568] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3411048-5318-4245-bd13-ad8c65f4de91" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.842372] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.842687] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.365023] env[65087]: INFO networking_nsxv3.common.synchronization [None req-5d05c550-b9fa-4ff0-99bb-41f80aeae936 None None] Enqueued Resource ID: 2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92 with Priority: HIGHEST for action port [ 1327.365023] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92 with Priority: HIGHEST for action port [ 1327.365023] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.365023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.365023] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.367171] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.367171] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.868464] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92 [ 1327.868634] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.868715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.868715] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.868925] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.869028] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.869128] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92 already deleted. [ 1327.869207] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e2a3a01-7ce4-4b0b-97c3-85f4e8a6ff92" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.422026] env[65087]: INFO networking_nsxv3.common.synchronization [None req-44eb2959-4a26-456e-8e3b-f569c1770e26 None None] Enqueued Resource ID: cfcf0f9e-8018-47a0-a74e-9533e376973f with Priority: HIGHEST for action port [ 1329.422026] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfcf0f9e-8018-47a0-a74e-9533e376973f with Priority: HIGHEST for action port [ 1329.422026] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfcf0f9e-8018-47a0-a74e-9533e376973f taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.422026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfcf0f9e-8018-47a0-a74e-9533e376973f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.422026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfcf0f9e-8018-47a0-a74e-9533e376973f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.422026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfcf0f9e-8018-47a0-a74e-9533e376973f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.422026] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfcf0f9e-8018-47a0-a74e-9533e376973f',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.927104] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfcf0f9e-8018-47a0-a74e-9533e376973f [ 1329.927362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.927505] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.927577] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.927803] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.927894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.927993] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfcf0f9e-8018-47a0-a74e-9533e376973f already deleted. [ 1329.928088] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfcf0f9e-8018-47a0-a74e-9533e376973f" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.700858] env[65087]: INFO networking_nsxv3.common.synchronization [req-832cc495-268a-42e0-bfad-cb29fef34cf2 req-cb37b4ef-ad93-4946-a007-0ce6bcf5b3f3 tempest-ServerPasswordTestJSON-1112421531 tempest-ServerPasswordTestJSON-1112421531-project-member] Enqueued Resource ID: 9a9a7657-09fd-499b-9a43-37005ae67454 with Priority: HIGHEST for action security_group_members [ 1332.701399] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a7657-09fd-499b-9a43-37005ae67454 with Priority: HIGHEST for action security_group_members [ 1332.701667] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a7657-09fd-499b-9a43-37005ae67454 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.701804] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.701888] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.702153] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.702315] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.702414] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.702477] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.702626] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.702711] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.702805] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9a7657-09fd-499b-9a43-37005ae67454',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.966294] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.966462] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "network-160" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.966586] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "network-160" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.966916] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "network-160" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.967196] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.967357] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.967472] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.967686] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.967851] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.968081] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.968198] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1332.968305] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1332.968412] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1332.968523] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.968628] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1332.968763] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1332.989422] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1332.989600] env[65087]: DEBUG dogpile.cache.region [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1332.989768] env[65087]: DEBUG dogpile.lock [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1332.989964] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "network-160" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.990294] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock port-96182412-3820-4da6-9c73-d010515a7324 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.990466] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "port-96182412-3820-4da6-9c73-d010515a7324" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.990587] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "port-96182412-3820-4da6-9c73-d010515a7324" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.990938] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "port-96182412-3820-4da6-9c73-d010515a7324" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.991094] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96182412-3820-4da6-9c73-d010515a7324',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.205373] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.205610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.205610] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.205840] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.205931] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.206140] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.206250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.206304] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.206453] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.206529] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.206616] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9a7657-09fd-499b-9a43-37005ae67454 already deleted. [ 1333.206698] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.493398] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.494110] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.494208] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.494936] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.494936] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.494936] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Segment Port 96182412-3820-4da6-9c73-d010515a7324 not found, creating... [ 1333.495071] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.495167] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.495274] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.495489] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.495624] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.495901] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.496067] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.496187] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.496436] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.496514] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.496649] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Resource: SegmentPort with ID: 96182412-3820-4da6-9c73-d010515a7324 is going to be created. [ 1333.517398] env[65087]: DEBUG networking_nsxv3.common.locking [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.517612] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.517933] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.517992] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.518238] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.518489] env[65087]: DEBUG oslo_concurrency.lockutils [None req-da92c6ca-0f74-4749-8440-2ff41e81ac04 None None] Releasing lock "port-96182412-3820-4da6-9c73-d010515a7324" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.204093] env[65087]: INFO networking_nsxv3.common.synchronization [req-832cc495-268a-42e0-bfad-cb29fef34cf2 req-a5c8e210-6bd1-4eab-bffe-0d0602b95b7c service nova] Enqueued Resource ID: 9a9a7657-09fd-499b-9a43-37005ae67454 with Priority: HIGHEST for action security_group_rules [ 1334.204328] env[65087]: INFO networking_nsxv3.common.synchronization [req-832cc495-268a-42e0-bfad-cb29fef34cf2 req-a5c8e210-6bd1-4eab-bffe-0d0602b95b7c service nova] Enqueued Resource ID: 9a9a7657-09fd-499b-9a43-37005ae67454 with Priority: HIGHEST for action security_group_members [ 1334.204403] env[65087]: INFO networking_nsxv3.common.synchronization [req-832cc495-268a-42e0-bfad-cb29fef34cf2 req-a5c8e210-6bd1-4eab-bffe-0d0602b95b7c service nova] Enqueued Resource ID: 96182412-3820-4da6-9c73-d010515a7324 with Priority: HIGHEST for action port [ 1334.204927] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a7657-09fd-499b-9a43-37005ae67454 with Priority: HIGHEST for action security_group_rules [ 1334.205082] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a7657-09fd-499b-9a43-37005ae67454 with Priority: HIGHEST for action security_group_members [ 1334.205183] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96182412-3820-4da6-9c73-d010515a7324 with Priority: HIGHEST for action port [ 1334.205529] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9a7657-09fd-499b-9a43-37005ae67454 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.205666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.205765] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.206176] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.206325] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9a7657-09fd-499b-9a43-37005ae67454',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.207238] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a7657-09fd-499b-9a43-37005ae67454 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.208068] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.208204] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.208438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.209024] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.209024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.209024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.209024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.209301] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.209580] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9a7657-09fd-499b-9a43-37005ae67454',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.210703] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-96182412-3820-4da6-9c73-d010515a7324 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.210894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96182412-3820-4da6-9c73-d010515a7324" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.211016] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96182412-3820-4da6-9c73-d010515a7324" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.211227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96182412-3820-4da6-9c73-d010515a7324" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.211356] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96182412-3820-4da6-9c73-d010515a7324',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.713833] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96182412-3820-4da6-9c73-d010515a7324 with status ACTIVE [ 1334.714107] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.714251] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.714322] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.714542] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.714635] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.714806] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.714909] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.714990] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.715130] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.715209] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.715383] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.715474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.715531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.715672] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.715745] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.715824] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96182412-3820-4da6-9c73-d010515a7324 is going to be updated. [ 1334.716944] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a7657-09fd-499b-9a43-37005ae67454 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.717151] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.717282] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a9a7657-09fd-499b-9a43-37005ae67454',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.739260] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.739443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.739483] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.739666] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.739846] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.740024] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96182412-3820-4da6-9c73-d010515a7324" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.220021] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a9a7657-09fd-499b-9a43-37005ae67454',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.724074] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.724074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.724074] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.724287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.724287] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.724346] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9a7657-09fd-499b-9a43-37005ae67454 is going to be created. [ 1335.749423] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.749572] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.749637] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.749919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.750097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.782696] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9a7657-09fd-499b-9a43-37005ae67454 in Status: UNINITIALIZED for 2s [ 1337.793664] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9a7657-09fd-499b-9a43-37005ae67454 in Status: SUCCESS [ 1337.793998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.793998] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.794286] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.794490] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.794601] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.794673] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.794831] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.794913] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.795026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.795091] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a9a7657-09fd-499b-9a43-37005ae67454',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.297967] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a7657-09fd-499b-9a43-37005ae67454 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.298250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.298250] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.298454] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.298665] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.298796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.298873] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.299097] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.299154] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.299228] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.299386] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a7657-09fd-499b-9a43-37005ae67454 taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.299520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.299590] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.299795] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.299970] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.300084] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.300146] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.300375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.300501] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.300640] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.300747] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a9a7657-09fd-499b-9a43-37005ae67454',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.803235] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a9a7657-09fd-499b-9a43-37005ae67454: rpc.has_security_group_logging(os_id): False [ 1338.820338] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.820536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.820536] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.820749] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.820857] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.821069] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.821173] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.821237] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.821392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.821472] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.821667] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.821761] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.821824] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.821959] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.822048] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.822236] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.822325] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.822416] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.822521] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.822594] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.822678] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9a7657-09fd-499b-9a43-37005ae67454 is going to be created. [ 1338.880723] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.880989] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.881155] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.881422] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.881668] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.892359] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9a7657-09fd-499b-9a43-37005ae67454 in Status: IN_PROGRESS for 2s [ 1339.206426] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1339.206621] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1340.908581] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9a7657-09fd-499b-9a43-37005ae67454 in Status: SUCCESS [ 1340.908956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.208207] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1344.208591] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1344.884460] env[65087]: INFO networking_nsxv3.common.synchronization [req-54e5c9f5-dcae-4c9d-97b8-cad5024508d1 req-68886829-aefe-4d6b-9abb-10b6c20b21d3 tempest-ServerPasswordTestJSON-1112421531 tempest-ServerPasswordTestJSON-1112421531-project-member] Enqueued Resource ID: 9a9a7657-09fd-499b-9a43-37005ae67454 with Priority: HIGHEST for action security_group_members [ 1344.884919] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a7657-09fd-499b-9a43-37005ae67454 with Priority: HIGHEST for action security_group_members [ 1344.885231] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a7657-09fd-499b-9a43-37005ae67454 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.885351] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.885654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.885654] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.885809] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.886233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.886233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.886233] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.886357] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.886390] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9a7657-09fd-499b-9a43-37005ae67454',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.388877] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.389328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.389328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.389328] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.389435] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.389614] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.389719] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.389785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.389996] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.390092] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.390181] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9a7657-09fd-499b-9a43-37005ae67454 is going to be updated. [ 1345.432875] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.433193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.433193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.433426] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.433593] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.442989] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9a7657-09fd-499b-9a43-37005ae67454 in Status: IN_PROGRESS for 2s [ 1347.454293] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9a7657-09fd-499b-9a43-37005ae67454 in Status: SUCCESS [ 1347.454767] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9a7657-09fd-499b-9a43-37005ae67454 deletion is rescheduled due to dependency. [ 1347.454767] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a7657-09fd-499b-9a43-37005ae67454" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.885869] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.885869] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1354.886958] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.887358] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.887645] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.888077] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.888381] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.888725] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.890320] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.890320] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.422908] env[65087]: INFO networking_nsxv3.common.synchronization [req-b17bc80b-de9e-4795-abf9-4e4b5062f88d req-7cdc870a-b8da-4592-a020-ec4c07bd0e10 tempest-AttachVolumeTestJSON-120673121 tempest-AttachVolumeTestJSON-120673121-project-member] Enqueued Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_members [ 1372.422908] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 with Priority: HIGHEST for action security_group_members [ 1372.422908] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9 taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.422908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.422908] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.423264] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.423264] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.423335] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.423439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.423551] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.423709] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.423764] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b723fa5-5c7f-4620-826a-1db0feb0d4c9',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.925755] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.925912] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.925983] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.926211] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.926307] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.926499] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.926599] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.926662] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.926808] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.926884] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.926968] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 is going to be updated. [ 1372.953381] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.953531] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.953606] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.953796] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.953936] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.962805] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 in Status: IN_PROGRESS for 2s [ 1374.973922] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 in Status: SUCCESS [ 1374.973922] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b723fa5-5c7f-4620-826a-1db0feb0d4c9 deletion is rescheduled due to dependency. [ 1374.974392] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b723fa5-5c7f-4620-826a-1db0feb0d4c9" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.197533] env[65087]: INFO networking_nsxv3.common.synchronization [None req-9325fa92-e7f0-42fc-8059-1dae396358be tempest-AttachVolumeTestJSON-120673121 tempest-AttachVolumeTestJSON-120673121-project-member] Enqueued Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_rules [ 1377.198390] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_rules [ 1377.198690] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.198825] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.198896] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.199166] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.199251] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.275964] env[65087]: INFO networking_nsxv3.common.synchronization [None req-c11c6c31-ee72-474d-a509-5b84717f3b5e tempest-AttachVolumeTestJSON-120673121 tempest-AttachVolumeTestJSON-120673121-project-member] Enqueued Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_rules [ 1377.276475] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_rules [ 1377.276796] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.276905] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.720105] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.720663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.720663] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.720874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.721057] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.721268] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e already deleted. [ 1377.721443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.721690] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.721976] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.722149] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.241504] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.241898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.241898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.241898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.242026] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.242100] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e already deleted. [ 1378.242179] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.106703] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-262 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.106893] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.107032] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.107307] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.107979] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.108193] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.108320] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.108547] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.108688] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.108906] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1379.109027] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1379.109137] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1379.109242] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1379.109350] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1379.109453] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1379.109584] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1379.130093] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1379.130306] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1379.130453] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1379.130628] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-262" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.130940] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.131125] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.131254] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.131488] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.131621] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f19fdd1-5616-44f3-81ad-05f4fa90aa0e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.634529] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.634966] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.634966] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.635203] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.635370] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.635656] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.635813] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.635931] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.636583] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.636583] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.636583] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.636772] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.636807] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.637017] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.637158] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.637296] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e is going to be updated. [ 1379.658634] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.658864] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.658968] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.659257] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.659458] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.659675] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.743107] env[65087]: INFO networking_nsxv3.common.synchronization [req-e89134df-558a-4eff-87c1-897763b43239 req-2b2710a1-713c-4653-b178-ff61f44737df service nova] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1380.743366] env[65087]: INFO networking_nsxv3.common.synchronization [req-e89134df-558a-4eff-87c1-897763b43239 req-2b2710a1-713c-4653-b178-ff61f44737df service nova] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1380.743458] env[65087]: INFO networking_nsxv3.common.synchronization [req-e89134df-558a-4eff-87c1-897763b43239 req-2b2710a1-713c-4653-b178-ff61f44737df service nova] Enqueued Resource ID: 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e with Priority: HIGHEST for action port [ 1380.743936] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_rules [ 1380.744313] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1380.744527] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e with Priority: HIGHEST for action port [ 1380.744895] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.745100] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.745214] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.745457] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.745583] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.746939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.747187] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.747262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.747585] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.747585] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.747685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.747758] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.747866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.747964] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.748075] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.749585] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.749674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.749720] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.749871] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.749952] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f19fdd1-5616-44f3-81ad-05f4fa90aa0e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.247698] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.247874] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.250953] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.252024] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e with status ACTIVE [ 1381.252156] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.252289] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.252337] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.252845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.252845] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.252845] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.253646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.253646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.253646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.253646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.253646] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.253646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.253646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.253646] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.253899] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.253899] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f19fdd1-5616-44f3-81ad-05f4fa90aa0e is going to be updated. [ 1381.275976] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.276230] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.276285] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.276556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.276739] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.276927] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f19fdd1-5616-44f3-81ad-05f4fa90aa0e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.753074] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.255406] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.255618] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.255674] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.255898] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.255994] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.256111] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1382.284674] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.284881] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.284973] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.285212] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.285360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.297465] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1384.308078] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1384.308579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.308579] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.308694] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.308875] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.308999] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.309078] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.309231] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.309597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.309597] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.309597] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.447759] env[65087]: INFO networking_nsxv3.common.synchronization [req-7fa836dc-cecc-4eae-a647-6c2b11f24262 req-4f69ee4e-cc4d-479c-90ad-ebbdab688167 tempest-AttachVolumeTestJSON-120673121 tempest-AttachVolumeTestJSON-120673121-project-member] Enqueued Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_members [ 1384.448371] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_members [ 1384.449202] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.449342] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.449436] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.449710] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.449939] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.450041] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.450102] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.450291] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.450375] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.450518] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.739243] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.739446] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "network-634" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.739565] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "network-634" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.739838] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "network-634" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.740098] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.740280] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.740411] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.740624] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.740767] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.741052] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1384.741294] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] NeedRegenerationException {{(pid=65087) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1384.741369] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] no value, waiting for create lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1384.741460] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] value creation lock acquired {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1384.741576] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] No value present for key: 'zone-id' {{(pid=65087) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1384.741684] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Calling creation function for not-yet-present value {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1384.741815] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1384.761122] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1384.761298] env[65087]: DEBUG dogpile.cache.region [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65087) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1384.761509] env[65087]: DEBUG dogpile.lock [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Released creation lock {{(pid=65087) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1384.761593] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "network-634" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.761960] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab taken with stack trace [, , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.762147] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.762267] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.762572] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.762728] env[65087]: DEBUG networking_nsxv3.api.rpc [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3810578-4c24-4e4c-bbf6-b48a8aa181ab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.811593] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1384.952451] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.952664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.952664] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.952919] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.953077] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.953263] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1384.953374] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1384.953431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1384.953596] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1384.953676] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1384.953761] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e already deleted. [ 1384.953843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.265080] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.265310] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.265430] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.265710] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.265857] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.266023] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Segment Port c3810578-4c24-4e4c-bbf6-b48a8aa181ab not found, creating... [ 1385.266283] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.266457] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.266607] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.266800] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.266951] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.267232] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.267390] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.267509] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.267713] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.267847] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.267984] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Resource: SegmentPort with ID: c3810578-4c24-4e4c-bbf6-b48a8aa181ab is going to be created. [ 1385.289751] env[65087]: DEBUG networking_nsxv3.common.locking [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.289961] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.290100] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.290457] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.290764] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.290918] env[65087]: DEBUG oslo_concurrency.lockutils [None req-8cc5fbe0-08aa-4ebe-95c7-96cad0aeb5ed None None] Releasing lock "port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.313652] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49706196-d349-4818-ae7e-d6615560719a: rpc.has_security_group_logging(os_id): False [ 1385.331954] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.332215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.332215] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.332387] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.332481] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.332782] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.332900] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.332966] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.333144] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.333227] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.333310] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1385.424181] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.424425] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.424478] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.424727] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.424924] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.440643] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1386.020576] env[65087]: INFO networking_nsxv3.common.synchronization [req-7fa836dc-cecc-4eae-a647-6c2b11f24262 req-892d9df2-1536-44f6-ac83-525ba589f178 service nova] Enqueued Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_rules [ 1386.020765] env[65087]: INFO networking_nsxv3.common.synchronization [req-7fa836dc-cecc-4eae-a647-6c2b11f24262 req-892d9df2-1536-44f6-ac83-525ba589f178 service nova] Enqueued Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_members [ 1386.020967] env[65087]: INFO networking_nsxv3.common.synchronization [req-7fa836dc-cecc-4eae-a647-6c2b11f24262 req-892d9df2-1536-44f6-ac83-525ba589f178 service nova] Enqueued Resource ID: c3810578-4c24-4e4c-bbf6-b48a8aa181ab with Priority: HIGHEST for action port [ 1386.021570] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_rules [ 1386.021708] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_members [ 1386.021828] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3810578-4c24-4e4c-bbf6-b48a8aa181ab with Priority: HIGHEST for action port [ 1386.022139] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.022262] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.022385] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.022528] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.022626] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.023558] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.023785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.023785] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.023901] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.024057] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.024159] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.024240] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.024380] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.024498] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.024546] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.025353] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.025508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.025508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.025638] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.025725] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3810578-4c24-4e4c-bbf6-b48a8aa181ab',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.527636] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.528142] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.528142] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3810578-4c24-4e4c-bbf6-b48a8aa181ab with status ACTIVE [ 1386.528307] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.528456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.528540] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.528798] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.528929] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.529166] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.529283] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.529384] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.529587] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.529693] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.529926] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.530079] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.530160] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.530378] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.530462] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.530572] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3810578-4c24-4e4c-bbf6-b48a8aa181ab is going to be updated. [ 1386.531978] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.558201] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.558443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.558443] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.558634] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.558779] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.558950] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3810578-4c24-4e4c-bbf6-b48a8aa181ab" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.035582] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.455226] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1387.455556] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.538362] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.538843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.538843] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.538956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.538956] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.539077] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e is going to be created. [ 1387.565223] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.565467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.565467] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.565656] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.565819] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.576536] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e in Status: UNINITIALIZED for 2s [ 1389.590059] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e in Status: SUCCESS [ 1389.590059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.590059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.590059] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.590059] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.590652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.590652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.590652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.590652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.590652] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.590902] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.093381] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1390.595700] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6480a7c-8693-4dcd-97b4-f63a98f6e76e: rpc.has_security_group_logging(os_id): False [ 1390.615131] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.615376] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.615431] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.615679] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.615788] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.616081] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.616216] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.616263] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.616439] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.616543] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.616636] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e is going to be created. [ 1390.678661] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.678892] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.678939] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.679177] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.679360] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.693076] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e in Status: IN_PROGRESS for 2s [ 1391.022903] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.023112] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1392.708077] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e in Status: SUCCESS [ 1392.708512] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.023992] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.024449] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.972704] env[65087]: INFO networking_nsxv3.common.synchronization [req-b57ef1fd-dc7b-4d3c-b095-ebb3ed262d5a req-6173f79f-9ee8-4df0-9043-562a92eac081 tempest-ServerActionsTestOtherB-1688726736 tempest-ServerActionsTestOtherB-1688726736-project-member] Enqueued Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1397.973301] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49706196-d349-4818-ae7e-d6615560719a with Priority: HIGHEST for action security_group_members [ 1397.973644] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-49706196-d349-4818-ae7e-d6615560719a taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.973800] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.973879] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.974083] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.974271] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.974377] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.974438] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.974600] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.974685] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.974814] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49706196-d349-4818-ae7e-d6615560719a',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.477250] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.477474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.477474] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.477716] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.477811] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.478018] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.478128] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.478193] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.478415] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.478508] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.478602] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a is going to be updated. [ 1398.505305] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.505520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.505520] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.505736] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.505890] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.515105] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: IN_PROGRESS for 2s [ 1400.527872] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49706196-d349-4818-ae7e-d6615560719a in Status: SUCCESS [ 1400.528267] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49706196-d349-4818-ae7e-d6615560719a deletion is rescheduled due to dependency. [ 1400.528267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49706196-d349-4818-ae7e-d6615560719a" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.974711] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.975213] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.976382] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.976382] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.977193] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.977554] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.978494] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.978876] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.979359] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.979725] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1427.980437] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1427.980856] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1432.981695] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1432.982153] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1437.982828] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1437.983288] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1442.983733] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1442.984169] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1447.984813] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1447.985153] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1452.986153] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1452.986519] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1457.987263] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1457.987641] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1462.864422] env[65087]: INFO networking_nsxv3.common.synchronization [req-e5d15a33-941d-440f-8230-88979c77f5b0 req-138e03ff-aa96-48a9-b3bf-4b0967fbee48 tempest-AttachVolumeTestJSON-120673121 tempest-AttachVolumeTestJSON-120673121-project-member] Enqueued Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_members [ 1462.864943] env[65087]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e with Priority: HIGHEST for action security_group_members [ 1462.865313] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e taken with stack trace [, , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.865452] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.865527] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.865757] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.866456] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.866456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.866456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.866456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.866456] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.866720] env[65087]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6480a7c-8693-4dcd-97b4-f63a98f6e76e',) {} {{(pid=65087) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1463.368786] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.369034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.369034] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.369267] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.369365] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.369567] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.369675] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.369738] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.369894] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.369970] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.370073] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e is going to be updated. [ 1463.406650] env[65087]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65087) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.406866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.406866] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.407064] env[65087]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.407219] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.416145] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e in Status: IN_PROGRESS for 2s [ 1465.427506] env[65087]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e in Status: SUCCESS [ 1465.427506] env[65087]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6480a7c-8693-4dcd-97b4-f63a98f6e76e deletion is rescheduled due to dependency. [ 1465.427506] env[65087]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6480a7c-8693-4dcd-97b4-f63a98f6e76e" {{(pid=65087) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.865735] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1467.866343] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1472.867184] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.867570] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1477.867896] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.868322] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.869087] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.869551] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.294511] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1487.294989] env[65087]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-c40f38c3-dca4-410b-a71d-6d62339c676e None None] NSXv3 Agent Agent loop - iteration:4 started [ 1487.870780] env[65087]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.870780] env[65087]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0